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SUMMARY  PACK 


PROBLEM 


Human  performance  tests  are  used  for  a  variety  of 
personnel  management  purposes.  In  each  case,  the  tests 
to  measure  some  ability  which  is  needed  for  performance 
problem  is  that  there  is  no  well-established  method  for 
ability  requirements  of  jobs,  and  hence  it  is  difficult 
priate  performance  tests. 


research  and 
are  supposed 
of  a  job.  The 
specifying  the 
to  choose  appro- 


FINDINGS 

Task  analysis  can  be  used  to  specify  the  ability  requirements  of 
jobs.  A  variety  of  task  analysis  methods  are  illustrated  by  the  papers 
in  this  collection,  and  their  application  to  enumeration  of  ability 
requirements  is  described. 


RECOMMENDATION 

It  is  recommended  that  task  analysis  be  employed  prior  to  perform¬ 
ance  test  selection  so  that  tests  can  be  chosen  to  be  relevant  to  Navy 
jobs . 


The  work  was  funded  by  the  Naval  Medical  Research  and  Development 
Command  and  by  the  Biological  Sciences  Division  of  the  Office  of  Naval  Research. 
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IWSK  ANALYTIC  APPROACH  TO  HOMAN  ‘’KKEUKMANCK  BATTERY  DEVELOPMENT 
Richard  H.  Shannon 

Naval  Blodynamlos  Laboratory,  New  Orleans,  1_A  70189 

ABSTRACT 

Task  analytic  methods  were  used  to  Isolate  critical  components  of  naval  student  flight  perfor¬ 
mance.  This  goal  was  accomplished  by  utilizing  factor  and  regression  analyses  to  compare  student  nan- 
ntver  errors  luring  primary  training  to  tin*  overall  phase  grades  of  primary,  basic  and  advanced.  The 
results  indicated  that  f l Iglit  ability  skills  appear  to  be  best  measured  by  basic  transitions,  coordina¬ 
tion  flying  and  entries  to  dirty  couf  igur  at  ions .  These  lt.*ms  caul  1  he  measured  within  a  flight  simula¬ 
tor.  In  a  laboratory ,  these  skills  could  best  be  measured  by  a  performance  battery  which  contained 
me  .lory,  problem-solving,  continuous  tracking,  tasks,  and  a  time-sharing  capability  between  continuous 
*  racking  and  discrete  tasks.  In  conclusion,  the  task  analytic  procedure  was  determined  to  be  a  feasible 
md  useful  undertaking  in  the  development  of  performance  measurement  systems  such  as  the  PETER  project. 


INTRODUCTION 

The  Naval  Biodynuinlcs  Laboratory  (NHL)  In  New 
Orleans  is  presently  attempting  to  develop  a  human 
performance  battery  (PETER,  Performance  Evaluation 
Tests  for  Envi ronment.il  Research),  which  will  be 
used  to  study  behavior  under  unusual  and  adverse 
conditions.  To  facilitate  the  accomplishment  of 
this  goal,  a  task  analysis  of  various  9.  S.  Navy 
jobs  and  work  stations  will  be  conducted.  In 
general,  the  steps  to  be  followed  from  Inventory 
development  to  battery  Unpl ementat Ion  will  be: 

( i >  Research  and  evaluate  the  existing  literature 
in  the  areas  of  task  analysis,  battery  development, 
and  performance  assessment;  (2)  Isolate  the 
critical  work  stations  onboard  U.  S.  Navy  ships 
which  are  Important  to  Its  peacetime  and  combat 
missions;  (3)  Complete  a  task  Inventory  of  these 
critical  work  stations;  (4)  Develop  a  question¬ 
naire  in  order  to  Isolate  the  recurring  critical 
elements  pertaining  to  a  particular  work  station; 

(>)  Translate  these  elements  into  perceptual - 
nsyohn'Vtor  behavioral  components;  and  (6)  Design 
a  perceptual  — psych  ••'motor  battery  to  be  used  at  NBL 
which  is  compatible  with  the  existing  work  ot  PETER. 

Previously,  the  author  had  followed  a  similar 
outline  for  the  purpose  of  developing  a  perfor- 
lu.u-o  battery  which  would  assess  Student  pilot 
behavior.  Although  the  battery  was  never  developed 
. r  i  n.’l  emented  ,  most  of  the  necessary  work  had 
been  con  looted .  The  purpose  of  this  report  will 
S-  tt  discus;  this  prior  effort  because  the  metho¬ 
dology,  lata  collection,  and  analyses  will  have  a 
ilr»"'t  l;n [ •  ir t  up-ui  the  future  direction  of  the 
program.  In  another  paper,  the  autho- 
<  \  .  tunoii  ,  l  '■>  S  w  ■  s  id  IiSi.us.se. i  the  development 
on-aver  r  \sV  Inver.i’  'r  I  **s ,  the  isolation  o*  critical 
In-  light  stt.ient  or  or.,  the  vail!.?  ion  an!  utility 
ktliololug  .in  l  t  ixonor,  1  •  .  lass i  f  1  ■*  1 1  1  on 

and  finally  the  potent  III  impact  .>f  tbi; 

•*f  i  r  t  ,pou  fut  ire  NBL  research.  Tu.*rofur*t  ? 

-,.i  !  >•  i*;:.pL,i  ;'.s  of  this  In  year  !)• -l?  Ion  will  '■•c  up  -n 
:  !.■  :>r*»d  i  t  1  ve  validity  of  ?h»-  model,  the  transla¬ 
tion  o  risks  info  h**na.  ioral  c  mp.  uient  s,  and  the 
i  r  I  rw •  ?  •  *  ic  •.  l gn  »t  a  performance  hatterv. 

METHOD 

**h.*  *  i  <>  >n  >n  i«  m *  1  el  .  wL  i «  >  w  i s  ]  I  so  us  s»>.l  :  n 
•  ...  i  •ureri-i1  ,  was  «>pr<i  In  at  •  to 


classify  recurring  student  pilot  flight  errors 
during  primary  flight  training  In  the  T-34  air¬ 
craft.  This  taxonomy  depicts  pilot  performance 
as  a  joint  function  of  continuous  and  discrete 
coromunLcat Ions ,  scanning,  and  controlling  opera¬ 
tions  that  occur  in  a  four  dimensional  inflight 
environment  of  pitch,  roll,  yaw,  and  thrust. 

These  tasks  are  performed  as  part  of  an  informa¬ 
tion  processing  loop  between  the  pilot,  aircraft, 
and  the  environment.  This  feedback  loop  contains 
the  components  of  display,  sensory,  cognition, 
motor  and  control.  Tills  classification  model, 
which  can  be  found  in  Shannon  (1980),  uses  two 
operations,  nine  activities,  and  35  functional 
objectives.  Discrete  operations  are  de  ined  as 
individually  distinct  movements  or  mediating 
responses  elicited  by  environmental  cu  s.  Contin¬ 
uous  operations  contain  those  tasks  involving 
multidimensional  tracking  responses  to  either 
contact  cues  outside  the  cockpit  or  flight  Instru¬ 
ment  cues  within  the  cockpit.  A  task  activity  Is 
a  qualitative  category  whose  main  function  involves 
either  a  sensory,  cognition,  motor,  or  coordinated 
percep tual -motor  task.  The  nine  activities  used 
In  this  paper  are:  continuous  tasks  involving 
control  of  the  pitch  axis,  roll  axis,  yaw  axis, 
thrust  axis  and  the  brakes;  and  discrete  tasks 
involving  control  of  aircraft  subsystems  (proce¬ 
dural),  judgment  and  planning  (anticipation/ 
planning),  transfer  of  information  (communication), 
and  searching  and  scanning  (monitor).  Finally, 
functional  objectives  are  tasks  having  the  same 
activity,  goal -or  lent. it  Ion ,  sensory  cues  and  task 
elements.  For  example,  continuous  pitch  axis 
control  contains  the  objectives  to  maintain 
altitude,  airspeed,  nose  attitude,  and  stick 
pressu  re . 

The  data  in  this  study  were  collected  prior 
to  1977  and  the  revision  of  the  naval  aviation 
training  program.  At  that  time,  training  con¬ 
sisted  of  four  phases:  prlmarv,  basic,  advanced 
and  the  repl  a  cement,  air  group.  This  studv  will 
concern  itself  with  the  first  three  phases,  A 
content  analysis  was  prrf >rmed  on  the  grading 
sheets  at  the  primary  phase  of  two  samples  of  >9 
students,  a  total  sample  si2e  of  78.  These 
■trading  sheets  contained  data  on  both  sidt<< 
pertaining  to  a  student’s  performance  on  a  nurti- 
ulir  hop.  On  the  front  page,  the  laneuvers  that 
were  performed  with  their  assoc!  1 1  **.l  grade  (aVn>‘.  »■ 


average  to  unsatisfactory)  arc  llstei.  When  a 
below  Average  or  unsatisfactory  grade  was  assigned, 
the  Instructor  had  to  Justify  his  iruuouver  grade 
by  listing  on  the  back  page  of  the  grading  Mieet 
the  errors  committed  by  that  student.  The  analyses 
In  tills  paper  were  performed  on  these  written 
cinnuients  and  classified  using  the  taxonomic  'no del 
descrihetl  in  the  previous  paragraph.  'Hie re  were 
2,l6l  errors  for  550  below  average/  unsatisfactory 
grades  in  the  first  sample,  while  the  second 
sample  committed  2,093  errors  for  529  below  average/ 
unsat isfactory  grades  on  the  15  uuneuver  and  tliree 
global  (headwork ,  procedures,  basic  afrwork)  Items 
which  demonstrated  deficient  performance. 

In  addition,  these  errors  wore  further  classi¬ 
fied  as  to  fundamental  flight  attitude  for  contin¬ 
uous  operations  and  task  purpose  for  discrete 
operations.  'Hie  fundamental  flight  attitudes  used 
in  the  analysis  of  continuous  tasks  were  straight 
climb,  climbing  turn,  straight  descent,  descending 
turn,  level  turn,  straight  and  level,  and  ground . 

On  the  basis  of  these  seven  attitudes,  it  was 
possible  to  characterize  a  maneuver  according  to 
transitions  from  one  flight  attitude  to  another  or 
the  maintenance  of  a  particular  flight  attitude. 

The  comparison  of  discrete  tasks  was  performed 
using  the  purpose  for  task  execution  as  the  basis 
for  the  analysis.  For  example,  the  following 
reasons  for  performance  of  the  functional  objective 
"anticipation  of  a  particular  position"  were:  to 
initiate  turn  completion,  to  commence  a  turn,  to 
communicate  a  voice  report,  and  to  add/retract 
power.  This  effort  resulted  in  89  and  74  cate¬ 
gories  of  continuous  and  discrete  flight  errors, 
respect ively . 

These  two  sets  of  error  categories  were 
factor  analyzed  separately  by  the  principal  axis 
and  rotated  by  the  varunax.  These  methods  tend  to 
maximize  the  percent  of  common  variance  shared  by 
a  factor  while  minimizing  the  overlap  between 
factors.  In  addition,  the.  factor  analytic  output 
resulted  In  factor  scores  wh Ich  are  the  sum  of  the 
products  between  maneuver  weights  and  error  cate¬ 
gory  standard  scores  on  each  maneuver.  All  error 
categories  with  a  factor  score  greater  than  1.0 
and  a  maneuver  factor  loading  greater  than  .21 
•were  used  in  the  prediction  model.  Student  error 
scores  were  recomputed  from  this  more  selective 
item  pool  by  multiplying  the  errors  in  each  cate¬ 
gory  by  the  maneuver  factor  loading.  Each  of 
these  products  were  then  summed  within  a  maneuver 
and  across  maneuvers  to  give  a  recomputed  factor 
error  score  for  each  student.  This  is  not  the 
first  time  factor  analysis  has  been  used  with 
respect  to  naval  aviation  training  (Bair,  bookman , 
MartoccLa,  1956;  b>oth,  Berkshire,  1968;  Wherry, 
Waters,  I960;  Bale,  Smith,  Ambler,  1972).  In  each 
of  these  cases,  the  analysis  used  grades  during 
the  various  phases  of  training.  The  present  study 
differed,  however,  by  using  Instructor  comments 
translated  Into  errors  as  the  basis  for  the 
anal  ys  is . 


Since  content  and  concurrent  valility  •,{  the 
primary  phase  data  had  been  established  mother 
study  (Shannon,  1980),  the  next  step  was  t  > 
establish  predictive  validity  and  the  relationship 
of  initial  flight  perl  'rniami'  f.»  l.iTf'r  pU.c.-s  if 
training.  series  of  stepwise  regressi  m  mu’.  V ~ 
ses  wen:  perform***}  using  the  overul 1  phase  grades 
for  primary,  basic  and  advanced  as  criterl  e> 
measures  on  the  first  sample  of  ly  students. 
Multiple  correlations  were  determined  using  the 
recomputed  student  error  scores  on  each  factor  as 
independent  variables.  Cross-validation  < as¬ 
sisted  of  using  the  same  maneuver  loadings,  error 
categories,  factor  structure  and  regression  beta 
weights  on  the  three  criterion  measure  equations 
from  the  first  sample  to  analyze  the  second 
sample.  With  the  data  validated,  both  samples 
were  combined  (N«?8)  and  a  third  series  of  te/t.s- 
siou  equations  were  computed  using  the  same  ;o, ag¬ 
grades. 

RESULTS  AND  HI SCI'SS ION 

From  the  two  separate  vartmax  rotations, 
twelve  factors  were  identified,  five  continue...* 
and  seven  discrete,  each  explaining  }«*  and  b'<* 
of  the  total  variance  respectively.  Table  1 
contains  the  results  of  these  two  rotations  with 
only  the  factor  loadings  of  .21  and  above  being 
shown.  These  factors  were  called  continuous 
tasks  during  field  entries,  emergency  landings, 
unusual  attitudes,  spins  and  basic  alrwork  perfor¬ 
mance;  and  discrete  tasks  that  occurred  during 
transitions,  stall  recovery  -nose  high,  or  nose 
low,  emergency  landings,  clearing'  break  turns, 
slow  flight,  and  course  rule  performance.  Ta‘  !e 
2  outlines  each  factor  by  name  and  its  significant 
functional  activities,  functional  objectives,  and 
fundamental  Flight  attitudes  (continuous  tasks' 
or  flight  purpose  (discrete  tasks).  Iti  other 
words,  the  significant  error  categories  are 
listed  by  factor. 

Table  2  contains  a  correlational  matrix  for 
both  predictor  factor  variables  and  criterion 
stage  grade  variables.  The  correlations  in  t‘-e 
matrix  Indicate  that  five  of  the  twelve  fact  r* 
have  a  rather  consistent  affect  on  performance 
throughout  pilot  training.  The  significant  *  an¬ 
ti  minus  factors  Indicate  that  maintaining  altitude 
and  airspeed  (pitch',  maintaining  distame  -roi: 
and  maintaining  heading  (yaw)  In  various  funda¬ 
mental  flight  attitudes  (turns,  descents,  climbs, 
straight  and  level)  are  important.  An  the  other 
hand,  the  critical  discrete  factors  are:  (1'  to 
use  the  throttle  and  to  anticipate  airspeed  and 
altitude  so  as  to  initiate  a  descent  or  to  level - 
off  from  a  descent;  (2)  to  raise  the  gear  on 
departure,  to  anticipate  altitude  for  level-off, 
and  to  determine  geographic  location  so  as  to 
adhere  to  Inflight  procedural  rules;  and  (3)  to 
use  throttle,  prop,  flaps  appropriately  when 
entering  slow  flight.  In  addition,  two  factors, 
field  entries  (continuous)  and  transitions  f  .i  1  s- 
crete),  are  highly  correlated  (r  -  .701.  The  im¬ 
portant  grading  items  outlined  by  these  five 
factors  are  -  headwork,  basic  alrwork,  procedures. 
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standard  and  home  field  entries,  slow  flight, 
transitions  and  course  rules.  In  general,  these 
results  Indicate  that  basic  alrwork  skills,  physical 
roordlnat Ion t  good  scan  pattern,  knowledge  of  pro¬ 
cedures,  ability  to  plan  ahead  of  the  aircraft, 
capability  to  t  Ime-share  and  handle  workload 
stress  are  Important  attributes  throughout  training. 
These  skills  or  abilities  seem  to  be  best  measured 
during  basic  transitions,  coordination  flying, 
steep  turns,  and  entries  to  dirty  configuration 
(lowering  the  landing  gear).  These  Items  could  be 
studied  either  In  a  flight  simulator  or  under 
actual  flight  conditions.  In  a  laboratory  setting, 
these  skills  could  best  be  measured  by  a  battery 
which  contained  memory,  problem-sol ving ,  and 
continuous  tracking  tasks  as  well  as  a  time-sharing 
capability  between  continuous  tracking  and  discrete 
tasks. 

Table  3  also  contains  multiple  correlations 
of  the  factor  analytic  scores  at  the  three  phases 
of  training.  Three  sets  of  data  are  presented: 
first  sample  of  39,  second  sample  of  39  using  the 
same  beta  weights  for  validation  purposes,  and  the 
combined  sample.  The  following  conclusions  can  be 
drawn  from  this  table:  (l)  the  taxonomic  classi¬ 
fication  of  student  error  has  predictive  validity, 
(2)  performance  in  primary  training  does  predict 
future  airborne  behavior,  which  may  indicate  that 
there  Is  a  general  factor  of  "flight  ability"  and 
that  this  factor  concurrently  exists  with  specific 
criterion  shifts  and  changes  within  the  task 
( changing-task  model),  (3A  there  is  a  decrease  in 
the  predictive  capability  of  the  data  base  the 
further  a  student  progresses  in  training,  which 
may  lemons t rate  that  there  are  specific  as  well  as 
i  hierarchy  of  skills  being  developed  throughout 
training  (changing-subject  model).  These  Last  two 
statements  direct  attention  to  the  controversy 
surrounding  temporal  changes  in  ability-skill 
relationships  (Alvares,  Hulin,  1972). 

The  changlng-task  model  (Fleishman,  1966) 
specifies  that.  In  order  to  explain  the  decreasing 
relationships  between  abilities  measured  early  in 
training  and  performance  measures  obtained  later, 
me  must  relate  different  abilities  to  performance 
it  the  /art  jus  stages  of  skill  acquisition.  In 
other  wn rli ,  the  internal  measuring  system  of 
flight  Instructors  within  naval  aviation  changes 
>v*- tine  In  that  their  emphasis  upon  specific 
rltlcil  components  or  skills  shifts  between 
training  stages  but  remains  relatively  constant 
vc  lu  :i  stage.  They  •  xpeof  mure  precise  behavior 
i-i  !  hotter  integrated  .>erf  >rroa:u:e  is  a  student 
■  r'.vr-fs-.r-'  through  training.  Flels'uaan  (19**6) 
to*.*1  that  the  Importance  of  noivnutor  abilities 
'  •  i  as,  sense rv,  verbal)  decrease'-*  systematic 
v  vt  t  «  pr  to  t  l  .*  e  ,  rel  a  t  Ivp  to  mo  tor  abilities. 

'  ;de.*  -  in  further  be  supported  by  Tahle  3 

v*  .  ■  i:l  is  t  r  *  t  e  s  that  miU  inmms  motor  factors 

*  r  •  • . ,-  •  >«  i  *  t  training  appear  to  be  more  predictive 

*  .a*  *he  im**  cognitive  discrete  tasks.  In  other 
W'T  .i.  ’he  sensorv,  cognitive  and  m»t*>r  capabl- 

•  i»-  *  '  ie  pilot  are  bnpi-rfanr,  but  the  total 

i  ei  and  -T»‘a  snre-Tpnt  o’  these  abilities  ran 
.*•  at*  lined  hv  r-b.se -*/1  n,-;  fbe  output  va  r  1  i'-i  rs 
•  ;nt  caparLty  as  a  part  of  a  feedback  In  p . 


The  chang  1  ng-suh  jee  t  model  ( Adams,  1957, 
Humphreys,  M60)  assumes  that  living  organisms 
show  constant  change,  and  that  measures  taken  at 
successive  Intervals  depict  this  change.  In 
other  words,  student  abilities  can  be  seen  a.s 
systematically  changing  over  time  within  a  con¬ 
stant  task  structure.  For  example,  Hnderwood 
(1977)  claimed  that  three  of  his  laboratory  tasks 
(tree  recall,  list  di f ferent lat  ion  ,  interference 
susceptibility)  measured  different  memory  abili¬ 
ties  because  of  the  low  correlations  between 
these  tests.  However,  when  the  scores  during  the 
stable  period  of  these  three  tests  (Days  7-14) 
were  factor  analyzed,  they  demons t ra t ed  a  high 
amount  of  explained  common  variance  (63  percent). 
Tills  difference  appeared  to  be  related  to  the 
level  of  training  of  the  subjects.  Underwood 
studied  one  day  of  learning  while  the  factor 
analyzed  material  Investigated  the  period  after 
six  days. 

To  summarize,  both  models  appear  to  explain 
the  decreasing  correlations  of  primary  phase 
errors  with  later  phases  of  training.  The  process 
of  flight  instruction  and  assessment  can  be 
viewed  as  a  feedback  loop  between  the  student, 
and  the  flight  Instructor.  The  instructor  esta¬ 
blishes  an  interna]  measurement  system  of  profi¬ 
cient  and  critical  performance  based  upon  student 
behavior  and  conversations  with  bis  peers.  On  the 
other  hand,  the  student  conforms  to  the  desires 
and  criticisms  of  the  flight  instructor.  His 
performance  becomes  more  Integrated  as  specific 
ab 11 1 t ies-skil 1 s  are  Intertwined  within  a  hierarchy 
as  components  of  a  more  advanced  ability-skill. 
Within  this  context,  the  task  and  subject  both 
change  over  time,  and  therefore  should  better 
explain  why  correlations  decrease  as  the  distance 
between  stages  of  training  increase. 

The  implications  of  the  results  of  this 
paper  are  significant  to  the  future  of  the  PETER 
project.  The  author  concludes  from  these  analyses 
that  the  task  analytic  procedure,  of  isolating 
critical  components  of  a  job  and  then  develop!  *.g 
performance  measurement  systems,  training  packages 
and  human  engineering  applications  based  upon 
these  components,  is  a  feasible  undertaking. 
Therefore,  task  analysis  will  be  an  integral  part 
in  the  future  development  of  a  battery  to  assess 
performance  within  unusual  environments  at  the 
Naval  Biodynamics  Laboratory. 
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TABLE  1:  TWO  WAR  I  MAX  ROIMInNS  IlFPIdlNG  FAC  DIR  LOAD  1  NOS  BY  (,K.\l)kli  i  1.1M ,  lAi.luk  ANN  oPLs.All'N 


GRADED  FLIGHT  ITl-MS 

CO  N  T  INCOGS  'oT'l 

C'AflON 

: ;  I 

KETK  ifj* 

1.  :\/\  i  . 

r 

!  ! 

l  t  1 

IV 

V 

I 

I  I 

1  I  I 

IV 

HEADWORK  (HD) 

.45 

.64 

.40 

.  26 

. : 

BASIC  AIRWORK  (BAW) 

.55 

.27 

.54 

.69 

.  78 

PROCEDURES  (PROC) 

.81 

.  !>  i 

.AP  PROACH/  LAND  I NC  /  TAKEOF  F  ( AP  P ) 

.21 

.22 

.21 

i 

STANDARD  FIELD  ENTRY  (SFE) 

.81 

.5  > 

.12 

.  12 

HOME  FIELD  ENTRY  (HFE) 

.88 

.  78 

.2- 

EMERGENCY  LANDING 

.67 

.  3  6 

.5 ' 

.12 

PRACTICE  (ELP) 

HIGH  ALTITUDE  EMERGENCY  (HAE) 

.8) 

.77 

LOW  ALTITUDE  EMERGENCY  (LAE) 

.65 

.81 

SLOW  FLIGHT  (SK) 

.68 

.21 

.84 

TRANSITION  (TRAN) 

.  50 

.02 

POWER-OFF  STALL  (POS) 

.21 

.24 

.78 

APPROACH  TURN  STALL  (ATS) 

.27 

.99 

PRECISION  SPIN  (PS) 

.61 

.94 

ACCIDENTAL  SPIN  (ACC  SP) 

.61 

.  24 

UNUSUAL  ATTITUDES  (UA) 

.68 

.87 

WINGoVER  (WO) 

.bb 

COURSE  RULES  (CR) 

PERCENT  COMMON  VARIANCE 

10.8 

11.2 

4  . 

4 . 4 

6.11 

3.7 

10.5 

8.  1 

!  2.4 

7 .9 

TABLE  2:  S  I  (IN  IF  I  CANT  ERROR  CATEGORIES  BY  FACTOR  AND  OPERATION 


FACTOR  NAME  (MANEUVER)  1  FUNCTIONAL  OBIECTIVK  FUNDAMENTAL  FUCHT 

(FUNCTIONAL  ACTIVITY)  ATTITUDE' FLIGHT  PURPOSE 


A.  CONTINUOUS  TASK  DURING: 

1.  FIELD  ENTRIES  MAINTAIN  AI.  TlTfiDF./ AI RSPEED  STRAIGHT  DESCENT,  LEVEL  TURN, 

(SEE,  HFE,  BAW)  (PITCH)  AND  DISTANCE  (ROLL)  STRAIGHT  .AND  LEVEL 

2.  EMERGENCY  LANDINGS  MAINTAIN  AIRSPEED  (PITCH)  AND  DESCENDING  TURN 

(HD,  PKOC,  ELF,  HAF-.  IAF.)  AND  RATE  OK  DESCENT/DISTANCE  (ROLL) 

J.  UNUSUAL  ATTITUDES  (UA,  WO)  MAINTAIN  A  CONTINUOUS  RATE  OK  CLIMBING  AND  DESCENDING  TURN 

NOSE  ATTITUDE  (PITCH)  AND 
ANGLE  OK  BANK  (ROLL)  WHILE 
MAINTAINING  BALANCED  FLIGHT  (YAW) 


TABLE  2:  (CONTINUED 


•«.  SPINS  (PS,  ACC  SP) 


5.  BASIC  AIRWORK  PER- 

KO RM A NCE  (BAW,  SF,  TRAN) 

DISCRETE  TASKS  DURING: 

1 .  TRANSITIONS  (BAW,  SFE, 
HEE,  TRAN) 


2.  STALL  RECOVERY 
(ATS,  UA) 

).  EMERGENCY  LANDINGS 
(HAE,  LAE) 


4.  CLEARING/BREAK  TURNS 
(ELP ,  POS,  PS) 


5.  SLOW  FLIGHT  CONFIGURA¬ 
TION  (PROC,  SF) 

6.  STALL  RECOVERY  (NOSE 
LOW)  (ACC  SP,  UA) 

7.  COURSE  RULE 
PERFORMANCE  (HD,  CR) 


MAINTAIN  A  SPECIFIC  NOSE  ATTI¬ 
TUDE  (PITCH)  ON  ENTRY;  OR 
NEUTRAL  STICK  PRESSURE  (PITCH), 
NEUTRAL  RUDDER  (YAW)  AND  WINGS 
LEVEL  (ROLL)  ON  RECOVERY 

MAINTAIN  ALTITUDE/ AIRSPEED 
(PITCH)  AND  HEADING  (YAW) 


USE  THROTTLE  (PROCEDURES),  AND 
ANTICIPATE  AIRS PE ED /ALTITUDE 


USE  THROTTLE  (PROCEDURES) 


USE  PROP/FLAPS/LANDING  GEAR/ 
CANOPY  (PROCEDURES)  AND 
DETERMINE  LANDING  AREA/WIND 
DIRECTION  (ANTICIPATION) 

ANTICIPATE  AIRSPEED/POSITION 
(ANTICIPATION) 


USE  THROTTLE/PROP/FLAPS 
(PROCEDURES) 

USE  THROTTLE  (PROCEDURES) 


USE  GEAR/CHECKLISTS  (PRO¬ 
CEDURES)  ,  .ANTICIPATE  ALTITUDE 
AND  DETERMINE  LOCATION 
(ANTICIPATION) 


STRAIGHT  DESCENT  ON  ENTRY  AND 
RECOVERY 


STRAIGHT  AND  LEVEL,  DESCENDING 
TURN,  STRAIGHT  CLIMB 


TO  LEVEL-OFF  FROM  A  DESCENT, 
INITIATE  A  DESCENT,  OR  MAINTAIN 
ALTITUDE 

TO  INITIATE  A  RECOVERY  WITH  FULL 
POWER 

TO  CLEAN-UP  FOR  GLIDE,  SELECT 
LANDING  AREA,  PREPARE  FOR 
LANDING 


TO  ROLL  INTO  AND  OUT  OF  A  TURN 
WHILE  MAINTAINING  A  SPECIFIC 
AIRSPEED  WITH  NOSE  ATTITUDE 

TO  ENTER  SLOW  FLIGHT  WHILE 
MAINTAINING  AI  ITUDE 

TO  INITIATE  A  RECOVERY  BY 
CLOSING  POWER 

TO  ADHERE  TO  INFLIGHT  OR  FIELD 
DEPARTURE  RULES 


TABLE  3:  CORRELATIONAL  MATRIX  AND  MULTIPLE  CORRELATIONS  OF  THE 
PREDICTOR  FACTOR  AND  CRITERION  PHASE  VARIABLES 


CORRELATIONAL  MATRIX  (N-78)  MULTIPLE 

CORRELATIONS 


OVERALL  PHASE 
GRADES*** 

CONTINUOUS 
l  2  3 

FACTORS* ** 

4  5 

1 

DISCRETE 
2  3 

FACTORS** 
4  5 

6 

7 

TOTAL 

(N-78) 

1ST 

(N=39) 

2ND 
( N =3  9) 

PRIMARY 

.a  n 

- 

- 

- 

.502 

.494 

.  322 

.226 

.  282 

.376 

- 

.319 

.743 

.701 

.686 

RAS  IC 

.516 

- 

.249 

- 

.312 

.423 

.320 

-  ■ 

.269 

.256 

- 

.327 

.  64  3 

.627 

.4  74 

ADVANCED 

.  390 

- 

- 

- 

.266 

.  34  7 

- 

.2  30 

- 

.266 

- 

.266 

.441 

.527 

.331** 

AVERAGE 

CORRELATION 

.515 

0 

.083 

0 

.  360 

.4  21 

.214 

.152 

.  184 

.  299 

0 

.304 

- 

- 

- 

*  ALL  CORREIAT IONS  ARE,  Ml  JUS  VALUES  AND  ARE  SIGNIFICANT  AT  P  .05 

**  HITS  CORREIAT  ION  p  .05,  REST  p  .01 

***  APPROXIMATE  FLIGHT  PHASE  LENGTHS  FOR  AN  AVERAGE  TRAINING  PERIOD  OF  15  MONTHS: 
PRIMARY  (0-4  MONTHS),  BASIC  (5-10  MOUTHS) ,  ADVANCED  (11-16  MONTHS). 


nir:  Wt.mTY  ok  task  anai.y ru:  inkokmation  ru  hi 'man  pkkf  >kma* 


kichtrd  H.  Sh.iiuuui 

Nava!  Hi <>dyn;ti»  tcs  laboratory,  New  -nieuii-.,  ’.A  ’  ■>  1  a '* 

r\HsrKA»:i 


Recurring  ti;i!  student  Might  errors  wer,*  ,-,»!!e«Ted  us  !-i,’  t  *  •  r  •  *  *-  ivnt-s  .>r  risk  i  i  vt  .  m- 1  ’ ;  >  :  > 

^  i  «■  s  :  ruiu-uvi1!  dvs,:r  L,.t  1-ui  q».e  s  t  louao  l  res ,  c  r  i  t  U  incident  t  e  1  }•*•  -  •  ;r  ••  1 

t : i . i  inflight  inane  iv«*r  forms.  The  results  from  these  »‘‘r**e  tHS-r's  w<r**  •  1  •*-  v  ■  r-«-  h**-', 

wh  ten  1  ti»i  i v  a  t  e  1  tint  the  task  m  il  vt  ic  me  t  hod  o!  ogv  wis  va'  11;  and  t  her*-  f  >r»*,  w-  ‘  iv*-  it  1:1  Tv  l**  f 

future  development  o  a  performance  battery  lor  envi  r.uunenr  .*!  rest-  jr 


i  \  i  viihii  r  l  » > n 

Task  analysis  Is  \  ~ie  r  hodo!  op 1  n!  tool  which 
.  • .  i ; ;  ho  use  1 :  f  P  t-‘  do  S-*  r  1  S»*  th*»  functions  per-- 

fumed  by  the  human  component,  f  .1 '  to  determine 
the  relative  position  of  ear1',  task  on  a  certain 
!  i  nr-us  ion  to  the  overall  job,  md  (J)  to  specify 
the  haiiki  i  capabilities  necessary  for  criterion 
performance.  The  results  of  a  valid  task  analysis 
can  aid  In  the  dec  is  l  an -making,  process  concerning 
personnel  selection,  training  and  assessment  as 
well  as  equipment  design  an  1  test  and  evaluation. 
•i>wever,  this  procedure  is  not  rigorous  In  the 
so  lent  if  l  -  sense,  but  Is  more  heuristic,  creative 
an*  innovative.  There  are  guidelines  as  to  how  a 
t  isk  an*!  vs  is  sh-oul  d  be  conducted,  but  there  are 
•i  >t  any  set  rules  that  can  reduce  this  technique 
t  '  i  routine  one  (Miller,  Lf*7P.  Researchers  in 
the  11  tori  tore  d  "*  ;nt  always  agree  on  method  and 
derinltlons,  and  much  of  the  work  is  fragment  try 
ant  inconsistent  without  utility  or  validity 
being  establlsaed  ( rhrlm,  1M6M;  Gh ambers,  19b9''. 
how-'ver,  the  literature  can  pr  wide  models  upon 
wh  i  ture  analysts  can  develop  their  task 

b*  v  r  tpt  i  o:ts  .  The  purpose  of  this  paper  will  be 
t  '  let*:  rmi  Me  utility  and  validity  of  task 
p  i!  v  s !  s  ns  w»l  '  is  r  »  outline  future  intentions 
.sing  f  saae  .lie  t  hodo  1  ugy  in  o the t  exotic  en- 
r  uim-uts  besiies  aviation.  To  accompl  Ish  these 
goals,  thro.*  related  me  thodol  ogles  and  their 
».  r  up..  .  error  Isolation  will  he  described. 

.ndef  t  .o  headings  of  Maneuver  Task  Analysis, 
r  i  t  I  »1  In  i-lent  Technique-  of  Grading  Sheets, 
i . .  *.  K 1  g; ,  t  R.1 1  L  n  g  Fo  rm  s . 

M  i  n  r  :  v  e  r  T  a  s  k  A:  i .  i  lysis 

P r  .  -r  t  >  l  -*7"'  and  the  revision  o t  the  nav.il 
i.h  tt  i-m  training  program,  prisnarv  flight  training 
iu  th»-  1  w  .ilrcralt  wa  divided  Into  two  stages, 
.*:•.-  and  prec  i  *i«*n.  Pre-sol  -»  consisted  of 

iua.  instruction  for  the  purpose  of  preparing  the 
-.•uieu?  pilot  t>  fly  solo  while  the  precision 
. f  i.p'  wti*.  ii’-ec-ted  t«*warl  Instruction  In  prei  i>l.>n 
hi1  a  r  ;>  itic  imnpuvr r  i ng .  Tne  pre-solo  stage 
* ! i s 1 s r e •  1  of  \i  dual  Instructional  hops.  Hy  the 
nil'  hop,  all  maneuvers  had  been  l  nt  ro<lu:»*d  »ud 
tu»*  stuiMut  began  to  prepare  for  his  final  check 
hop  pri  )  r  to  solo.  That  Is,  after  Hop  R,  the 
.  b*nt  -vhoul  i  have  Seen  able  t  •  execute  a!  ’ 
:n,ineuvers  without  committing  any  major  errors. 

Mop  12  was  the  safe-f or-sol o  check  flight,  and  If 
considered  safe  by  the  Instructor,  the  student 
soloed  on  Hop  IT.  Beginning  with  Hop  ■  * ,  the 
instructor  rated  a  student’s  performance  on  the 
?1  maneuvers  executed  by  assigning  him  either  an 


ah>ve  avera.p-,  averag*-,  .  >•  •. ••  r  .i  .•  «•  -  i  .  s.- *  l  - - 

factory  gra;**.  !'•  ••  T  w:u.  -..r  .**  i  :  ••  w»  -  * 

selected  f*»r  the  »  »s-*  v  i  v  r  1 .  t.-".  c.  v;.' 

fhev  hid  a  higher  uu"d‘**r  o  h**‘  iw  r.-t-ri**** 
an«i  therefore,  were  eons'!  iereJ  t  : a.-rv  r  l  \  \  ■> 

t>  student  pe  r  f  >  r;!u:c' e  :  st  anda  r  1  ’  : ■  i  entrv. 
high  altitude  “Tiiergeticy ,  pr**  ■i^i,',i  spi-'. , 
f’ap  approach  1  landing 't  ake«.f  f  ,  appro,  i  ' 
stall,  and  si  >w  f  1  ly.h*  .  T'.er,.-  six  .:,.no  :.''.*rs 

represented  fcl  percent  of  t’.e  tutil  ;; umber  : 
below  average  grad.es  for  the  "?*'  st  sr.(  . 

Three  other  items  (  basic  airwork,  ,e  i<iwo  r’*- ,  pro¬ 
cedures'  on  the  instructor's  rating  f •  ■> n:.  .  v 

considered  f  >r  analysis  at  this  t  irac  hut  t'.«-\  i; 
a  higher  number  of  below  averages  than  the  ma;.- 
eu  ve  r  s  s  e  \  '-c  t  ed  .  Tire  se  1 1  .'ms  do  not  1  e  nd  t  .  e.T.  - 
SeiVes  to  de  t a  i  .  e d  de sc  r  i  p  t  lo us  s  i u ..  e  t  ‘ .e  v  •> i  t 
g I  obal  sk  11 1  s  eiu:  o;ii|Msi  I  ng  al  1  maueuve  r  s  . 

Ta-dx  mane  ivor  lose  r ipt  i 'ns  were  devel  o;  t  i 
using  t'ne  T-3-*  Primary  1-tmeuvei  Description  hv.i- 
book.  Task  Inventory  development  was  pe  r  f  .*r:.  e  1 
in  gradually  refined  stages  with  the  anal  vs  1- 
proceeding  from  large  units  of  information  hi  .>v;ks 
to  success ive! v  more  detailed  lower  levels.  A 
similar  method  was  use  1  bv  the  aut  mr  t„  de  v  hn- 
naval  flight  officer  and  pilot  fun  t  lea  -»!  t.-..-.k> 

(Shannon,  lhfiha)  .  The  «pial  i  tat  ive  model  util  tzed 
in  this  study  followed  a  flight  maneuver,  s..- 
tlal  phase,  sequ.T.tial  step,  fur.ctioual  1  '<  ‘i.e 
(task  level)  an-d  task  element  h.  ierorch.  i  al  breakdown 
Each  block  of  information  witv.in  this  pvtair.ic  was 
considered  to  be  a  conceptual  whole.  leMuent  :ai 
phases  were  an  arrangement  of  those  sequential 
steps  according  to  aircraft  changes  in  funda.  *::u  V. 
flight  attitude.  These  changes  encompassed  the 
initiation,  maintenance  and  completion  of  either 
a  fllmh,  descent,  turn,  straight  and  level  ,  o r 
ground  operation,  wliich  wer*’  considered  separate!  v 
'r  in  combination  fsii'h  as,  climbing  !nr"  .  d*-'s- 
e;i  ling  turn'*.  Sequential  steps  were  .list  1  n't 
j-ioi-edur.jl  operations  that  were  performed  serially 
i*  ng  a  time  .  »ntinuum.  Tiesc  steps  contair.ei 
f  ri- *  i  oral  oh  h*  fives  that  occurred  cone  ar  ret'.  1 1  v 
md  w<>r-‘  an  trrmgement  of  those  task  el  omen t  s 
per  forcing  the  same  function.  Task  element  -  were 
considered  t  •  be  parts  of  an  information  proces¬ 
sing  !  o 'p  between  the  pilot,  air-raft  and  the 
envi  ronment .  Tills  feedback  loop  c  ontained.  t".e 
fallowing  components  of  display,  sensory, 

'ogiiM'n,  mot-'r  and  aircraft  control  .  A  task 
element  stat«-ment  contained  an  action  verb  with  a 
definite  oh  feet.  Approximately  1 s  action  verbs 
were  classified  according  to  a  sensors,  cognition, 
motor  an>!  c  ominun  Icat  ion  taxoturny,  and  were  uti¬ 
lised  in  these  maneuver  descriptions.  The  utility 
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of  a  taxonomy  and  standardized  action  verbs  Is  to 
allow  the  analyst  to  classify  human  activities,  to 
have  similar  meaning  and  wording  within  task 
statements,  and  to  perform  a  commonal  1  ty  analysis 
across  maneuvers. 

The  Initial  maneuver  descriptions  utilizing 
this  conceptual  model  and  the  T-34  Primary 
Maneuver  Description  handbook  were  checked  for 
completeness  and  accuracy  by  seven  flight  lntruc- 
tors  assigned  to  primary  training.  On  the  basis 
of  their  comments,  suggestions  and  criticisms, 
revisions  were  made.  Since  the  intent  of  this 
effort  was  to  Isolate  recurring  student  problem 
areas  during  pre-solo  training,  these  maneuver 
descriptions  were  given  a  questionnaire  format 
with  the  following  dichotomous  scales:  (l)  Does 
this  item  represent  a  frequent  error  committed  by 
the  average  student  on  all  hops  In  primary 
training?,  and  (2)  If  the  Item  is  an  error,  is  It 
critical?  Critical  error  was  described  as  one 
which  affected  a  student’s  grade  and  was  consi¬ 
dered  essential  to  the  performance  of  the  maneuver. 
These  preliminary  questionnaires  were  reviewed  by 
four  primary  flight  Instructors  in  the  same  format 
to  be  used  by  the  total  sample.  The  purpose  of 
this  simulation  was  to  gain  insight  into  respondee 
attitudes  toward  the  inventories.  Their  comments 
were  then  Incorporated  into  a  final  version  and 
distributed  to  97  primary  flight  instructors, 
which  was  close  to  total  participation  by  the 
squadron.  The  average  length  of  these  maneuver 
descriptions  was  10  steps  and  123  task  elements. 

The  inventories  were  completed  by  100%  of  the 
instructors.  Upon  their  return,  the  data  were 
coded  for  computer  analysis.  Percentages  were 
assigned  for  each  of  the  task  elements  according 
to  the  number  of  Instructors  who  considered  the 
element  to  be  an  error  that  was  frequently  per¬ 
formed  by  the  average  student  and  to  be  crlt leal 
to  his  performance .  In  addition,  percentages  were 
also  assigned  at  the  functional  objective  and  step 
levels  according  to  the  number  of  instructors 
responding  to  any  of  the  elements  within  that 
objective  or  step.  Since  these  two  scales  were 
considered  to  he  Independent,  their  percentages 
were  multiplied  together.  This  result  was  assumed 
to  indicate  the  number  of  Instructors  who  believed 
this  item  to  be  both  frequent  and  critical. 

Stated  another  way,  this  percentage  was  considered 
to  be  the  probability  of  either  a  task  element, 
functional  objective  or  sequential  step  containing 
errors  which  would  result  In  a  below  average  or 
unsatisfactory  maneuver  grade.  A  rank-ordering  of 
these  elements,  objectives  or  steps  by  these 
probabilities  of  occurrence  were  an  indication  of 
the  more  serious  flight  problems  of  student  pilots 
along  both  the  time  and  type  dimensions  of  maneuver 
pe  rf  o  rraance . 

A  commonality  analysis  was  performed.  Each 
task  element,  functional  objective  and  task  acti¬ 
vity  were  analyzed  for  similarity  and  were  combined 
across  the  six  maneuvers.  Standardization  of 
wording,  meaning  and  function  within  the  task 
element  statements  greatly  assisted  this 


effort.  The  result  is  the  taxonomic  outline  in 
Table  l  which  was  to  be  used  to  classify  student 
performance.  Tvo  operations,  nine  activities, 
and  35  functional  objectives  are  shown,  which 
conceptually  depict  flight  performance  as  a 
joint  function  of  continuous  and  discrete  communi¬ 
cations,  scanning  and  controlling  operations  that 
occur  in  a  four-dimensional  Inflight  environment 
of  pitch,  roll,  yaw  and  thrust.  Discrete  opera¬ 
tions  are  defined  as  individually  distinct  move¬ 
ments  or  mediating  responses  elicited  by  environ¬ 
mental  cues.  Continuous  operations  contain  those 
tasks  involving  multidimensional  tracking 
responses  to  either  contact  cues  outside  the 
cockpit  or  flight  instrument  cues  within  the 
cockpit.  An  activity  is  one  whose  main  function 
involves  either  a  sensory,  cognition,  motor,  or 
coordinated  perceptual -motor  task.  A  functional 
objective  Is  defined  as  part  of  a  maneuver  having 
the  same  activity,  performance  goal,  sensory 
cues,  and  task  elements.  A  functional  objective 
by  step,  which  was  the  task  or  error  level  used 
in  the  maneuver  descriptions,  has  the  same  defini¬ 
tion  as  the  preceedlng  statement.  The  difference 
between  both  categories  Is  that  one  combines 
objectives  over  time  and  the  other  is  limited  to 
a  sequential  step  or  phase.  The  nine  activities 
outlined  In  this  paper  are  very  similar  to  those 
used  by  other  authors  (Miller,  1971;  Alluisl, 

1967;  Folley,  1964;  Teichner,  Whitehead,  1971; 
Kelley,  Prosln,  1968).  At  the  functional  objec¬ 
tive  level,  however,  this  congruence  diverges. 

The  following  list  of  task  activities  and  termino¬ 
logy  from  the  literature  will  demonstrate  this 
similarity:  (1)  monitor  -  scanning,  detecting, 

identifying,  monitoring,  watchkeeping,  sensing, 
searching;  (2)  procedural  -  short/long  term 
memory,  process,  procedures-  following,  discrete 
motor,  switching;  (3)  anticipation/planning  - 
intellectual,  dec  Is ion-making,  problem-solving, 
planning;  (4)  communication  -  communication;  and 
(5)  continuous  pitch,  roll,  yaw,  thrust,  brakes  - 
continuous  perceptual-motor,  tracking,  action. 

The  Importance  of  the  taxonomic  classifica¬ 
tion  depicted  in  Table  1  Is  its  utility  as  a  tool 
and  a  structural  model  for  future  research  into 
performance  assessment,  selection,  training,  and 
human  engineering.  Without  a  unifying  system, 
Chambers  (1969)  believed  it  would  be  exceedingly 
difficult  to  achieve  generalization  of  research 
results,  communication  between  research  and 
applied  workers,  application  of  research  results 
to  applied  problems,  and  utilization  of  data 
acquired  from  one  applied  situation  to  another. 
This  outline  can  now  be  used  with  other  methodolo¬ 
gies  (critical  incident  technique,  rating  forms) 
in  the  determination  of  the  size  and  scope  of 
recurring  student  pilot  error. 

Critical  Incident  Technique  of  Grading  Sheets 

The  critical  incident  technique  (Flanagan, 
1954)  was  applicable  to  the  alms  of  this  investi¬ 
gation,  which  was  to  determine  the  validity  of 
the  task  analytic  Information  and  to  establish 
the  utility  of  the  taxonomic  classification  of 
pilot  behavior  presented  In  Table  1.  The  inci- 


dents  with  which  this  technique  deals  are  descrip¬ 
tions  of  directly  observable  human  activities  which 
are  sufficiently  complete  In  themselves  to  permit 
Inferences  to  be  made  about  the  person  performing 
the  act.  For  the  Incident  to  be  critical.  It 
must  describe  segments  of  human  behavior  that  are 
pertinent  to  a  desired  objective,  such  as  student 
pilot  error  while  performing  flight  maneuvers. 

This  methodology  outlines  specific  procedures 
whereby  human  error  can  be  catalogued,  described 
and  analyzed. 

On  each  flight  after  hop  4,  the  flight 
Instructor  had  to  rate  a  student*s  performance  by 
listing  on  the  front  page  either  an  above  average, 
average,  below  average  or  unsatisfactory  grade 
for  each  of  the  observed  maneuvers.  When  a  below 
average  or  unsatisfactory  grade  was  assigned,  the 
Instructor  had  to  justify  this  critical  Incident 
by  specifying  on  the  back  page  of  the  grading 
sheet  the  errors  committed  by  that  student.  The 
flight  records  of  70  students  were  selected  at 
random  for  analysis.  Two  criteria  had  to  be  met 
for  final  selection:  (1)  overall  primary  stage 
grade  for  each  student  had  to  be  between  2.95  and 
3.10,  which  was  considered  to  be  average  perfor¬ 
mance,  and  (2)  each  of  the  students  completed 
advanced  flight  training,  and  therefore,  were 
designated  naval  aviators.  A  content  analysis 
was  performed  on  these  written  ccroraents  from  the 
back  pages  of  the  grading  sheets,  and  the  errors 
were  classified  using  the  taxonomic  model  in 
Table  1. 

The  Naval  Flight  Student  Reference  Manual 
was  developed  from  this  analysis.  This  manual 
contains  a  detailed  listing  of  the  student  errors 
in  this  study,  vrtiich  are  classified  according  to 
maneuver,  type  (activity,  objective,  error)  and 
time  (step,  phase).  In  addition,  this  information 
is  divided  into  two  parts:  (1)  flight  maneuver 
section  presenting  2029  errors  by  660  below 
average/  unsatisfactory  grades  for  70  students, 
and  (2)  global  item  section  outlining  1020 
errors  by  182  below  average/unsatisfactory  grades 
for  39  students.  The  2029  errors  listed  for  the 
70  students  in  the  flight  maneuver  section  of  the 
manual  was  used  in  the  comparison  between  the 
task  analytic  and  rating  form  data.  From  this 
data  pool,  typical  procedural  activity  errors 
using  the  throttle  control  could  be  classified  as 
to  omission  problems  (no  power  addition,  retrac¬ 
tion  or  adjustment),  sequence  problems  (power 
applied  early/late,  out  of  sequence  wth  another 
control,  slow  to  adjust  power),  and  commission 
problems  (power  reversals  during  retardation/ 
advancement,  power  setting  high/low,  rough  throttle 
usage).  In  addition,  the  following  errors  were 
associated  with  the  activity  of  continuous  control 
In  the  pitch  axis:  (1)  high,  low  or  erratic 
control  of  nose  attitude;  (2)  late,  slow  or  no 
nose  movement;  (3)  fast,  slow  or  erratic  control 
of  airspeed;  (4)  gains,  losses  or  erratic  control 
of  altitude;  (5)  overcontrol  of  or  rough  on  flight 
stick;  (6)  late,  not  enough  or  no  trim;  (7)  poor 
or  no  overall /external /Internal  scan  pattern;  (8) 
slow  to  see  or  does  not  see  errors;  and  (9)  slow 
to  make  or  performs  poor  error  corrections. 


Flight  Rating  Forms 

Flight  maneuver  rating  forms  were  constructed 
on  the  basis  of  the  same  conceptual  model  utilized 
In  the  task  analytic  questionnaires  and  the 
critical  Incident  analysis  of  the  grading  sheets. 
These  forms  were  used  to  evaluate  the  performance 
of  21  students  on  the  four  hops  Immediately 
preceding  the  pre-solo  check  flight  (hop  12).  It 
was  assumed  that  student  performance  was  somewhat 
stable  during  this  period,  and  therefore,  a 
meaningful  analysis  could  be  conducted.  In  all, 
the  following  ten  maneuvers  were  selected  from 
the  total  21  potential  Items  (minus  the  three 
global  Items) ,  which  represented  85  percent  of 
the  total  number  of  below  averages  assigned  to 
the  70  students:  slow  flight,  power-off  stall, 
precision  spin,  approach  turn  stall,  high  alti¬ 
tude  emergency,  low  altitude  emergency,  emergency 
landing  practice,  and  full  flap  approach/  landing/ 
takeof  f . 

The  rating  forms  were  designed  to  be  read¬ 
able,  easy  to  grade  and  small  enough  to  be  placed 
upon  the  pilot’s  kneeboard.  Sequential  phases 
and  task  activities  were  outlined,  respectively, 
along  the  columns  and  rows.  Functional  objectives 
were  abbreviated  and  placed  within  the  matrix  of 
phases  and  activities.  A  decision  was  made  to 
use  only  one  common  functional  objective  by  phase 
rather  than  having  each  step  specified.  The  loss 
of  information  was  considered  to  be  small  with  a 
concurrent  increase  in  the  efficiency  and  effect¬ 
iveness  of  data  collection.  To  ensure  user 
acceptance,  two  flight  instructors  evaluated  the 
forms  during  a  preliminary  trial  period.  After 
this  evaluation,  comments  and  criticisms  were 
noted  and  minor  changes  to  the  forms  were  incor¬ 
porated.  The  rating  checklists  were  then  distri¬ 
buted  to  eight  primary  flight  instructors,  who 
were  required  to  simply  check  each  error  when  it 
occurred  during  maneuver  performance.  In  addi¬ 
tion,  the  instructors  were  requested  to  assign  the 
usual  grades  of  above  average,  average,  below 
average,  or  unsatisfactory.  In  this  way,  the 
frequency  and  criticalness  of  the  errors  could  be 
assessed . 

The  analysis  of  the  performance  by  21  stu¬ 
dents  over  the  ten  maneuvers  Indicated  that  there 
were  683  errors  for  132  below  averages,  899 
errors  for  255  averages,  and  117  errors  for  82 
above  averages.  These  results  demonstrate  an 
approximate  linear  relationship  between  grades 
and  average  number  of  errors  with  5.2  and  1.4 
errors,  respectively,  being  assigned  to  below 
average  and  above  average  performance.  The  total 
number  of  below  average  errors  were  used  In  the 
comparison  of  data  with  the  other  two  methodolo¬ 
gies.  An  examination  of  the  average  number  of 
errors  by  grade  and  task  activity  Indicated  that 
the  most  frequent  and  critical  errors  are  pitch 
control,  roll  control,  ant ic Ipat lon/plannlng  and 
procedures.  The  average  errors  for  each  of  the 
three  grades  over  the  eight  task  activities  are 
similarly  distributed  as  tested  by  a  chi-square 
goodness  of  fit  test  (  2  -  .505,  df  •  16,  non¬ 

significant).  Two  Important  conclusions  can  he 
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derived  fr,>m  this  analysis:  (1)  errors  occur 
even  when  performance  Is  considered  proficient, 
and  (2)  the  difference  between  the  various 
levels  of  performance  is  mainly  In  the  number  of 
errors  observed  within  specific  task  activities. 

When  the  rating  forms  were  initially  developed 
and  the  study  designed,  the  assumption  was  that 
student  performance  was  relatively  stable  or 
reliable  during  the  four  flights  Immediately 
preceding  the  pre-solo  check  flight.  To  test 
this  hypothesis,  the  number  of  maneuver  errors  on 
the  most  critical  and  frequent  task  activities  of 
pitch,  roll,  ant ic ipat Ion/ pi ann Ing  and  procedures 
were  compared  between  two  flights.  Fifteen 
students  had  been  observed  on  two  flights  over 
the  ten  maneuvers.  In  other  words,  a  fly-fly 
reliability  was  determined  by  comparing  the 
performance  of  15  students  on  four  task,  activities 
(fjO  cases)  on  two  consecutive  days.  The  result 
was  a  correlation  of  .725  which  meets  the  cri¬ 
terion  for  stability  as  established  by  the  PETER 
battery  development  program.  Another  study 
(Vllcoxon,  et  al ,  1952)  which  attempted  to  deter¬ 
mine  naval  student  flight  reliability,  resuLted 
in  a  rather  low  correlation  of  .31.  This  poor 
result  could  possibly  be  explained  by  the  project's 
emphasis  upon  specific  error  within  each  maneuver. 
For  example,  a  student  could  denwnstrate  the  same 
error  or  error  type  on  different  maneuvers  over 
both  days.  This  occurrence  would  then  lower  the 
reliability.  If  commonality  of  error  across 
maneuvers  had  been  considered  in  the  Wileoxon 
study,  it  is  quite  possible  that  its  resultant 
reliability  would  have  approximated  the  result  in 
the  present  investigation. 

Val  iditv  of  Task  Analysis 

Recurring  inflight  errors  bv  student  naval 
aviators  during  primary  training  In  the  T-34 
aircraft  were  isolated  using  three  related  methodo¬ 
logies:  maneuver  task  analytic  questionnaires, 
content  analysis  of  student  grading  sheets,  and 
inflight  checklists  of  maneuver  performance .  The 
turue  efforts  were  independent  in  that  there  was 
a  different  instructor  an  1  student  sample  in  each 
case.  However,  the  results  were  comparable 
because  each  thrust  had  the  same  taxonomic  model 
as  depicted  in  Table  l.  For  this  reason,  each 
method  is  considered  to  be  a  task  analytical 
procedure . 

Concurrent  validities  of  the  three  student 
error  assessment  techniques  were  determined 
turough  correlation  of  each  method's  results  by 
sequential  steps,  functional  objectives  and 
functional  objectives  by  steps  within  each  man¬ 
euver.  These  cor r ela t ions  are  shown  in  Table  2. 

The  number  of  cases  comp . ire J  were  dependent  upon 
the  number  of  maneuvers  and  tine  levels  of  analy¬ 
sts.  The  questionnaires  collected  data  on  six 
maneuvers.  Functional  objectives  are  the  35 
1  istei  In  Table  1,  and  functional  objectives  bv 
■steps  are  these  same  35  items  at  a  more  precise 
level,  that  of  each  procedural  step.  These  re¬ 
sults  indicate  a  h  Igher  relationship  between  the 
rating  forms/content  of  grading  sheets  than  either 


comparison  of  questionnaires  with  the  other  two 
methods.  All  validity  estimates  are  highly 
significant.  In  addition,  the  correlations 
remain  very  similar  across  the  three  levels  of 
analysis  within  each  of  the  comparisons.  Two 
conclusions  can  be  stated  based  upon  these  esti¬ 
mates:  (l)  flight  Instructors  are  consistent  in 

their  determination  of  student  errors,  and  (2) 
they  are  more  consistent  when  they  are  rating 
observed  behavior  rather  than  questionnaire 
raa ter lal  . 

ms  CUSS  ION 

The  task  analytic  procedure  as  outlined  in 
this  paper  has  demonstrated  a  high  level  of  both 
content  and  concurrent  validity  as  well  as  high 
rel  iab  11  i t  les  for  both  .students  and  Instructors. 
The  utLlity  of  these  results  can  be  summarized: 

(1)  a  valid  taxonomic  model  has  been  developed, 

(2)  valid  maneuver  task  descriptions  have  been 
outlLned,  (3)  a  clearer  and  more  meaningful  pic¬ 
ture  of  student  pilot  behavior  has  emerged,  (4) 
valid  assessment  of  student  pilots  can  be  accom¬ 
plished  during  the  stable  and  reliable  period  of 
the  three  or  four  hops  preceding  the  pre-solo 
check  flight,  (5)  inflight  maneuver  ratings  were 
developed  which  did  elicit  valid  and  reliable 
data  and  had  flight  Instructor  acceptance,  and 
(6)  the  information  determined  from  this  study 
could  have  an  impact  upon  naval  student  selection 
training  and  assessment. 

Presently,  the  Naval  Biodynami cs  Laboratory 
(NBL)  in  New  Orleans  is  attempting  to  develop  <* 
human  pe rfomwmce  battery  (Pt'ibiK,  Performance 
Evaluation  Tests  for  Environmental  Research), 
which  will  be  used  in  unusual  and  adverse  environ 
ments.  The  major  thrust  of  the  program  at  this 
moment  is  to  study  various  cognitive,  perceptual 
and  psychomotor  tasks  in  order  to  determine  their 
stability  and  sensitivity  over  repeatei  measure¬ 
ments  in  a  laboratory  setting.  However,  a  task 
analysis  of  various  M.  S.  Navy  jobs  and  work 
stations  must  be  conducted  if  the  battery  1*  to 
have  appl icabil i ty  to  human  performance  under 
actual,  and  simulated  conditions.  The  technique, 
which  has  been  described  in  this  paper,  has  the 
capability  to  not  onLy  define  a  particular  job, 
but  to  isolate  the  critical  components  of  that 
job.  These  elements  in  turn  would  provide  the 
basis  for  a  performance  measurement  system,  which 
can  be  utilized  Ln  both  the  laboratory  and  the 
actual  environment  (Shannon,  1980b).  In  conclu¬ 
sion,  the  author  believes  that  the  methodologies 
and  model  discussed  in  this  paper  will  aid  in  the 
deve'opment  of  functional  inventories  and  In  the 
assessment  of  performance  in  the  oceanic  environ¬ 
ment,  and  therefore,  will  influence  the  gr^wt1,  of 
the  NBL  battery. 
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TABLE  l  :  TAXONOMIC  OUTLINE  I1SKD  TO  CLASSIFY 
STUDKN  T  ERRORS 


A.  Continuous  Operations  -  tasks  Involving  multi¬ 
dimensional  tracking  responses. 

1.  Pitch  Axis  Control  -  aircraft  control  In 
nose  up /down  axis. 

maintain  (a)  altitude,  (h)  airspeed,  (c) 

nose  attitude,  (d)  stick  pressure 

2.  Rol l  Axis  Control  -  aircraft  control  In 
the  wing  up/down  axis. 

maintain  (a)  angle  of  break,  (b)  dis¬ 
tance,  (c)  heading,  (d)  rate  of 
descent,  (e)  stick  pressure 

3.  Yaw  Axis  Control  -  aircraft  control  in 
the  nose  Left/~Vht  axis. 

maintain  (a)  t,  -meed  flight,  (b)  heading, 
(c)  rudder  pressure 

4.  Thrust  Axis  Control  -  aircraft  control  of 
f  o  rva  rd  mo  verse  n  t . 

maintain  (a)  rate  of  descent,  (b>  throttle 
pressure 

5.  Brake  Control  -  aircraft  control  during 
ground  operations  by  turning,  stopping  or 
changing  speed. 

maintain  (a)  brake  control 

B.  Discrete  Operations  -  tasks  involving  indivi¬ 
dually  distinct  movements  or  mediating  re¬ 
sponses. 

1.  Procedural  -  control  of  aircraft  sub¬ 
systems  by  not  omitting,  reordering  or 
improperly  performing  necessary  sequen¬ 
tial  steps. 

use  (a)  flaps,  (b)  landing  gear,  (c)  fuel 
swi tches/ lever ,  (d)  canopy,  (e) 
throttle,  (f)  prop,  (g)  battery /magne- 
toes,  (h)  equipment,  (1)  checklists 

2.  Ant Ic lpat ion/ Planning  -  tasks  involving 
judgment,  planning  and  "being-ahead"  of 
a  1 rcraf t . 

anticipate  (a)  aircraft,  (b)  position, 

(c)  altitude,  (d)  airspeed, 
determine  (e)  wind  direction,  (f)  land¬ 
ing  site,  (g)  location 

3.  Communication  -  tasks  involving  transfer 
of  Information  from  one  source  to  another, 
communicate  (a)  verbally,  (b)  visually 

4.  Monitor  -  searching  and  scanning  Inside/ 
outside  the  cockpit  for  aircraft  safety 
and  maintenance  of  flight. 

scan  (a)  for  aircraft/obstructions 

(b)  temperature/ pres sure  instruments 
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TABLE  2:  CORRECTIONS  OF  STUDENT  ERRORS  BY  COM¬ 
PARING  THE  THREE  TASK  ANALYTICAL  METHODOLOGIES  AT 
THREE  LEVELS  OF  ANALYSIS 


ANALYTIC  METHODOLOGY*** 
(CASES  IN  PARENTHESIS) 


ANALYSIS 

LEVELS 

(1) 

(2 

) 

o> 

STEPS 

.578  (57)* 

.527 

(51  >* 

.850 

(Ml* 

.HU 

(30)** 

OB 1KCTIVKS 

,50-.  (89)* 

.  585 

f  9Q)  * 

.821 

f«0  1  * 

.00  2  ! 

157)** 

OBJECT  IVES 

.558  (210)* 

.■<08 

(210)* 

.-JO  < 

210)* 

BY  STEPS 

.'36  < 

162;** 

*  Comparison  of  data  for  six  maneuvers 

**  Comparison  of  data  for  ten  maneuvers 
***  All  correlations  beyond  .0001  significance 
level 

(1)  Quest lonnal res/Content  Analysis 

(2)  Quest  ioima  ires /Rat  Lng  Forms 

(3)  Content  Analysis/Rating  Forms 
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INTRODUCTION 

Task  analysis  is  a  methodological  tool  which  can  he  used:  (1)  to  des¬ 
cribe  the  functions  performed  by  the  human  component,  (2)  to  determine  the 
relative  position  of  each  task  on  a  certain  dimension  to  the  overall  job,  and 
(3)  to  specify  the  human  capabilities  necessary  for  criterion  performance. 

The  results  of  a  valid  task  analysis  can  aid  in  the  decision-making  process 
concerning  personnel  selection,  training  and  assessment  as  well  as  equipment 
design  and  test  and  evaluation.  However,  this  procedure  is  not  rigorous  in 
the  scientific  sense,  but  is  more  heuristic,  creative  and  innovative.  There 
are  guidelines  as  to  how  a  task  analysis  should  be  conducted,  but  there  are 
not  any  set  rules  that  can  reduce  this  technique  to  a  routine  one  (Miller, 
1971).  Researchers  In  the  literature  do  not  always  agree  on  method  and  de¬ 
finitions,  and  much  of  the  work  is  fragmentary  and  inconsistent  without 
utility  or  validity  being  established  (Farina,  1969;  Chambers,  1969).  However, 
the  literature  can  provide  models  upon  which  future  analysts  can  develop 
their  task  descriptions.  For  example,  two  different  approaches  to  task 
analysis,  hierarchial  and  time-line  scenario,  were  used  by  the  author  to 
describe  naval  flight  officer  functions  in  eight  navy  aircraft  (Shannon, 

1980a),  and  naval  student  pilot  behavior  while  performing  six  flight  maneuvers 
(Shannon,  1980b). 

Presently,  the  Naval  Biodynamics  Laboratory  (NBDL)  in  New  Orleans  is 
attempting  to  develop  a  human  performance  battery  (PETER,  Performance  Evalua¬ 
tion  Tests  for  Environmental  Research),  which  will  be  used  to  study  behavior 
under  unusual  and  adverse  conditions  (Kennedy,  Bittner,  Harbeson,  1980).  To 
facilitate  the  accomplishment  of  this  goal,  a  task  analysis  of  various  U.  S. 
Navy  jobs  and  work  stations  will  be  conducted.  In  general,  the  steps  to  he 
foL lowed  from  inventory  development  to  battery  implementation  will  be:  (1) 
Research  and  evaluate  the  existing  literature  on  performance  assessment;  (2) 
Isolate  the  critical  work  stations  onboard  U.  S.  Navy  ships  which  are  important 
to  its  peacetime  and  combat  missions;  (3)  Complete  a  task  inventory  of  these 
critical  work  stations;  (4)  Develop  a  questionnaire  in  order  to  isolate  the 
recurring  critical  elements  pertaining  to  a  particular  work  station;  (5) 
Translate  these  elements  Into  perceptual -psychomotor  behavioral  components ; 
and  (6)  Design  a  perceptual -psychomotor  battery  to  be  used  at  NBDL  which  is 
compatible  with  the  existing  work  of  PETER. 

Previously,  a  similar  progression  had  been  followed  in  the  development 
of  three  task  descriptions,  which  were  used  to  evaluate  naval  student  pilot 
training  (Shannon,  1980a).  Although  this  information  was  never  used  to  aid 
In  the  development  of  a  performance  battery,  most  of  the  necessary  work  had 
been  conducted.  The  purpose  of  this  paper  will  be  to  discuss  this  prior 
effort  because  the  outlined  methodology,  data  collection  and  analyses  will 
have  a  direct  impact  upon  the  future  direction  of  the  PETER  program. 
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Method 

Mechanics  of  Task  Description 

A  statement  of  purpose  is  necessary  from  the  beginning  In  order  to  give 
structure  throughout  the  descriptive  and  analytical  stages.  This  statement 
shouLd  contain  the  goals  to  be  achieved  and  the  personnel  to  be  studied  while 
using  specified  equipment  components  under  certain  environmental  conditions. 
Another  prerequisite  for  the  analyst  is  the  attainment  of  a  detailed  knowledge 
of  the  job,  environment,  and  system  to  be  investigated.  This  knowledge  could 
be  arrived  at  through  expert  opinion,  on-site  observations,  research  litera¬ 
ture,  interviews,  open-ended  questionnaires,  existing  task  descriptions,  pro¬ 
cedural  system  handbooks,  and  pertinent  human  engineering  standards  documents. 

Task  inventory  development  is  performed  in  gradually  refined  stages  with 
the  analysis  proceeding  from  large  units  of  information  blocks  to  successively 
more  detailed  lower  levels.  The  qualitative  model  of  the  three  projects 
described  in  this  paper  followed  a  job,  role,  duty,  task  and  element  hier- 
archial  breakdown.  In  this  model,  a  job  was  defined  by  its  roles,  a  role  by 
its  duties,  a  duty  by  its  tasks,  and  a  task  by  its  elements.  A  task  can  also 
be  defined  as  a  unit  of  work  which  is  directed  toward  the  accomplishment  of  a 
goal .  A  task  statement  should  contain  an  action  verb  with  a  definite  objec¬ 
tive,  and  should  specify  or  imply  the  personnel,  equipment  and  environmental 
conditions  involved.  Approximately  70  action  verbs  were  classified,  defined 
and  utilized  in  these  three  studies  based  upon  the  following  four-category 
task  taxonomy:  sensory/perception ,  cognition,  communication  and  psychomotor. 
This  taxonomy  is  in  general  agreement  with  the  literature.  The  utility  of  a 
taxonomy,  and  standardized  action  verbs  are  to  allow  the  analyst  to  classify 
human  activities,  to  have  similar  meaning  and  wording  within  task  statements, 
and  to  perform  a  commonality  analysis  across  jobs.  The  remaining  portions  of 
this  paper  will  now  describe  the  three  Navy  projects  for  which  the  author 
developed  task  inventories. 

Task  Inventory  Development 

In  1973,  the  Chief  of  Naval  Air  Training  (CNATRA)  decided  to  upgrade, 
revise  and  evaluate  pilot  training.  This  program  involved  three  pipelines 
(propeller,  jet,  helicopter),  three  phases  (primary,  basic,  advanced)  and 
eight  types  of  aircraft.  The  author  while  stationed  at  NAMRL  in  Pensacola 
was  the  sole  consultant  during  development  of  three  task  descriptions,  one 
for  each  of  the  training  pipelines.  The  descriptions  listed  all  of  the  tasks 
an  undergraduate  pilot  performed  while  he  was  in  training.  The  inventories 
when  completed  were  administered  to  all  fleet  replacement  air  groups  (RAGs) 
in  order  to  determine  the  following  information  on  three  five-point  scales; 

(1)  How  frequently  is  the  task  actually  performed  at  the  RAG  activity?  (Fre¬ 
quency)  ,  (2)  How  important  is  it  that  students  be  trained  in  the  task  as 
undergraduates?  (Criticality),  and  (3)  How  well  does  the  training  command 
presently  train  students  in  the  task  relative  to  RAG  entry  level  require¬ 
ments?  (Training  Adequacy) . 

In  order  to  accomplish  this  task,  it  was  necessary  to  have  representa¬ 
tives  frcxn  each  of  the  pipelines  and  stages  of  undergraduate  pilot  training 
(UPT).  These  representatives  were  instructed  in  the  "how  of  task  writing"  and 
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were  supervised  throughout  the  development  of  the  inventories  by  the  author. 

To  ensure  a  complete  inventory  of  tasks,  a  matrix  was  used  on  each  duty. 

This  schematic  contained  a  behavioral  dimension  of  action  verbs  from  the  task 
taxonomy  (Y  axis)  and.  a  functional  dimension  of  equipment  or  goals  (X  axis). 
The  interior  of  the  matrix  was  completed  by  the  representative  instructors 
with  a  simple  "yes"  or  "no"  answer  to  the  question  "Is  this  task  done?". 

The  next  step  in  the  development  of  the  inventories  was  the  comparison 
of  tasks  throughout  the  various  stages  and  phases  of  training.  Primary  phase 
tasks  were  compared  with  the  tasks  in  the  various  stages  of  the  Basic  phase, 
which  in  turn  were  compared  with  tasks  of  the  Advanced  phase.  At  the  conclu¬ 
sion  of  this  step,  there  were  three  groups  of  tasks  (let,  propeller  and 
helicopter  pipelines)  which  e  standardized  in  meaning  and  wording.  In 
addition,  a  commonality  analysis  was  performed  in  order  to  determine  the 
common  tasks  between  pipelines  and  the  specific  tasks  within  pipelines.  This 
effort  would  later  allow  for  generalizations  to  be  stated  concerning  the  L'PT 
program  as  well  as  cross-comparisons  within  and  between  fleet  aviation  comm¬ 
unities. 

The  three  inventories  were  then  typed  and  administered  to  a  limited 
number  of  training  command  instructors  in  the  same  questionnaire  format  to  be 
used  later  in  the  replacement  air  groups.  The  purpose  of  this  simulation  was 
to  gain  insight  Into  respondee  attitudes  toward  the  inventories.  In  addition, 
the  training  command  instructors  were  asked  to  add  or  to  consolidate  tasks 
when  necessary.  These  lomments  were  then  incorporated  into  a  final  version. 
The  final  three  inventories  were  then  prepared  for  replacement  air  group 
distribution.  The  average  length  of  the  inventories  was  340  tasks,  and  the 
average  number  of  common  tasks  across  the  three  pipelines  was  276  or  81  per¬ 
cent  of  the  total.  Each  of  the  Marine  and  Navy  replacement  air  groups  on 
both  the  East  and  West  Coasts  were  visited.  The  task  analysis  questionnaires 
were  completed  by  most  of  the.  Instructor  pilots  on-board  for  an  average  com¬ 
pletion  rate  of  88  percent. 

Upon  return  frcxn  the  field,  all  data  were  coded  for  computer  analysis. 
Each  of  the  tasks  were  analyze!  by  the  quantitative  data  from  each  scale,  and 
then  tne  tasks  were  rank-ordered.  An  "underemphasized"  task  was  considered 
to  be  one  which  was  ranked  70%  or  higher  on  the  "criticality"  scale  and  30% 
or  lower  on  the  "adequacy"  scale.  An  "overemphasized"  task  had  the  reverse 
order.  This  filtering  technique  enabled  the  analysts  to  isolate  those  tasks 
which  needed  to  be  improved  or  added  to  training,  and  those  tasks  that  could 
be  reduced  or  omitted  from  training.  The  average  number  of  "overemphasized" 
and  "underemphasized"  tasks  across  pipelines  were,  respectively,  4.3%  and 
7.2%. 

Results  and  Discussion 

A  behavioral  analysis  was  performed  on  the  seventeen  most  underemphasized 
tasks  in  each  of  the  three  pipelines.  The  assumption  is  that  these  tasks 
(highly  critical,  inadequately  trained)  would  form  the  most  valid  foundation 
of  a  performance  battery  to  assess  pilot  behavior.  In  all,  there  were  37 
different  tasks  which  were  studied.  Individually,  each  flight  task  contains 
elements  which  can  be  considered  as  parts  of  an  Information  processing  loop 
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between  the  pilot,  aircraft  and  the  environment.  This  feedback  loop  contains 
the  following  components  of  display,  sensory,  cognition,  motor  and  aircraft 
control.  This  analysis  dissected  the  37  flight  tasks  into  194  task  elements 
which  were  classified  as  to  their  behavior  activities  of  scan,  cognition, 
control  and  communication;  flight  operations  of  takeoff /landing  and  inflight; 
and  flight  conditions  of  normal  and  emergency /cont ingency .  The  results  of 
this  analysis  can  be  seen  in  Table  1  which  indicated  that  control ,  takeoff/ 
landing  and  emergency /cont ingency  elements  had  the  highest  number.  The 
latter  two  classifications  are  more  significant  when  one  considers  that  most 
pilot  functions  are  performed  inflight  under  normal  conditions.  The  result 

TABLE  1 

The  Classification  of  the  Under  emphasized  Task 
Elements  by  Activity,  Operation  and  Condition 


ACTIVITY 

OPERATOR 

CONDITION 

SCAN 

54 

TAKEOFF/LANDING 

103 

NORMAL 

92 

COGNITION 

52 

INFLIGHT 

91 

EME  RGE  NCY  /  CONT  I N  GE  NCY 

102 

CONTROL 

74 

COMMUNICATION 

14 

that  motor  functions  are  more  important  than  nonraotor  abilities  (sensory, 
cognition)  has  been  supported  by  other  authors  (Fleishman,  1966;  Shannon, 
1980c) . 


A  content  analysis  of  these  37  undereraphasized  tasks  was  performed.  The 
tasks  having  the  most  commonality  are  listed  below: 

A.  Scan 

1.  Scan  inside  the  cockpit  at  pertinent  instruments  (altimeter, 
airspeed,  needle/ball,  navigation,  temperature,  pressure,  fuel,  etc.)  which 
will  present  necessary  information  for  flight  maintenance  (25). 

2.  Scan  outside  the  cockpit  (ground  references,  other  aircraft, 
flight  and  wing  attitudes)  at  pertinent  cues  and/or  obstructions  for  purposes 
of  safety,  navigation  and  flight  information  (29). 

B.  Cognition 

1.  Calculate/apply  aerodynamic  principles  for  proper  aircraft 
performance  (during  all  types  of  takeoff s/ landings/ditchings,  stalls/spins, 
emergencies,  hover)  (44). 

2.  Assess  system  effectiveness  and  mission  capability  of  the 
aircraft  (through  judgment,  composure,  malfunction  isolation,  crosscheck  of 
degradation)  (8)  . 


C.  (lommunlcat Ion 


1.  Communicate  Information  pertaining  to  aircraft  performance 
(with  controlling  agencies  or  crew  during  emergencies/clearance/approach/ 
departure;  with  maintenance  personnel  while  recording  system  malfunctions) 
(9). 


2.  Apply  proper  communication  procedures  (during  clearance, 
approach/'  departure,  emergencies)  (S). 

D.  Control. 

1.  Control  aircraft  during  stall  or  low  lift  conditions  (departed 
flight,  spin,  high  angle  of  attack,  power  settling,  autorotation)  (18). 

2.  Control  aircraft  during  takeoff /landing  emergencies  (aborted 
takeoff,  engine-out  waveof f/landing,  ditched/ forced  landing)  (18). 

3.  Control  aircraft  during  emergencies  while  troubleshooting/coping 
with  the  situation  (6). 

4.  Control  aircraft  during  normal  approach  and  landing  (line-up, 
crosswind  approach/ 1 anding/rol lout ,  high  gross  weight  takeof f/ landing ,  landing 
rollout  on  wet/ icy  runway)  (29). 

5.  Control  aircraft  during  hover  in  response  to  crew  chief  direc¬ 
tions  (3)  . 

The  results  of  this  analysis  indicate  that  a  battery  which  was  designed 
to  assess  aviator  performance  should  contain  visual  search/scan,  problem¬ 
solving,  continuous  leg  and  two-handed  tracking  tasks,  as  well  as  simul¬ 
taneous  tests  to  evaluate  an  Individual’s  time-sharing  capability  and  judg¬ 
ment  under  stress.  As  demonstrated  by  these  results,  the  technique,  described 
in  this  paper  has  the  capability  to  not  only  define  a  particular  job,  but  to 
isolate  the  critical  components  of  that  job.  These  elements  in  turn  can 
provide  the  basis  for  a  performance  measurement  system,  which  can  be  utilized 
in  both  the  laboratory  and  the  actual  environment  (Shannon,  1980c).  In 
conclusion,  the  author  believes  that  the  methodologies  and  model  discussed  in 
this  paper  will  aid  in  the  development  of  functional  inventories  in  the 
oceanic  environment,  and  therefore,  will  influence  the  growth  of  the  NBDL 
ba  t  tery  . 
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Task  analysis  is  a  me thodological  tool  which 
can  he  used:  (1)  to  describe  the  functions  per¬ 
formed  by  the  human  component  In  a  sysrem,  (2)  to 
determine  the  relative  position  of  each  task  on  a 
certain  dimension  to  the  overall  job,  and  (3/  to 
specify  the  human  capabilities  necessary  for  cri¬ 
terion  performance.  The  results  of  a  valid  task 
analysis  can  aid  In  the  dec  Is  ion-making  process 
concerning  personnel  selection,  training  and 
assessment  as  wet  l  as  equipment  design  and  test  and 
evaluation.  However,  this  procedure  is  not  rigor¬ 
ous  in  the  scientific  sense,  but  Is  more  heuristic, 
creative  and  innovative.  There  are  guidelines  as 
to  how  a  task  analysis  should  be  conducted,  but 
there  are  not  any  set  rules  that  can  reduce  this 
technique  to  a  routine  one.  Researchers  in  the 
Literature  do  not  always  agree  on  method  and  ue- 
rinitions,  and  much  of  the  work  is  fragmentary  ind 
inconsistent  without  utility  or  validity  being 
established.  However,  the  literature  t  in  provide 
models  upon  which  future  analysts  can  develop  their 
functional  descriptions.  The  purpose  o*  this  paper 
will  be  to  describe  the  task  analytic  approach  used 
by  this  writer  on  three  separate  U.  S.  Navy  con¬ 
tracts  involving  airborne  functions  and  to  out  I  ine 
future  intentions  using  the  same  methodology  in  a 
different  unusual  environment. 

Mechanics  of  Task  Description 

A  statement  of  purpose  is  necessary  from  the 
beginning  In  order  to  give  structure  throughout  the 
descriptive  and  analytical  stages.  This  statement 
should  contain  the  goals  to  he  achieved  and  the 
personnel  to  be  studied  whiLe  using  specified 
equipment  components  under  certain  environmental 
conditions.  Another  prerequisite  for  the  analyst 
Is  the  attainment  of  a  detailed  knowledge  of  the 
job,  environment,  and  system  to  be  investigated. 
Tils  knowledge  could  be  arrived  at  through  expert 
opinion,  on-site  observations,  research  literature. 
Interviews,  open-ended  questionnaires,  existing 
task  descriptions,  procedural  system  handbooks,  and 
pertinent  human  engineering  standards  documents. 

Task  inventory  development  Is  performed  in 
gradually  refined  stages  with  the  analysis  pro¬ 
ceeding  from  large  units  of  Information  blocks  to 
successively  more  detailed  lower  levels.  The 
qualitative  model  of  tiie  three  projects  described 
in  this  paper  followed  a  job,  role,  duty,  task  and 
element  hlerarchlal  breakdown.  In  this  model,  a 
job  was  defined  by  Lts  roles,  a  role  by  Its  duties, 
a  dutv  by  Its  tasks,  and  a  task  by  its  elements.  A 
task  can  also  be  defined  as  a  unit  of  work  ditch  Is 
directed  toward  the  accomplishment  of  a  g >al  .  A 
task  statement  should  contain  an  action  verb  with  a 
definite  objective,  and  should  specify  or  imply  the 
personnel,  equipment  and  environmental  conditions 
Involved.  Approximately  70  action  verbs  were  class¬ 
ified,  defined  and  utilised  in  these  three  studies 
based  upon  the  following  four-category  task  taxo¬ 
nomy  r  sensory/perception,  cognition,  common  teat  ion 
and  psychnmotor .  This  taxonomy  Is  In  general 
agreement  with  the  literature.  The  utility  of  a 
taxonomy  and  standardized  action  verbs  is  to  allow 
the  analyst  to  classify  human  activities,  to  have 


slsnilar  meaning  and  wording  within  task  statements, 
and  to  perform  a  commonality  analysis  across  Jobs. 
The  remaining  portions  of  this  paper  will  now  des¬ 
cribe  the  three  Navy  projects  for  which  the  author 
developed  task  inventories. 

Naval  Flight  Officer  Project  (1,  2) 

In  1971,  tlie  Chief  of  Naval  Operations  (CNOj, 
recognized  a  need  to  revise  the  naval  flight 
officer  (NFO)  training  program  and  to  determine 
future  training  equipment  requirements  and  charac¬ 
teristics.  In  response  to  this  need,  the  Naval 
Aerospace  Medical  Research  laboratory  (NAMRb)  In 
Pensacola,  Florida  was  requested  to  conduct  a 
series  of  Invest  Igat ions  analyzing  the  operational 
functions  of  the  NFO  in  the  F14,  F4,  A6,  P3C,  P3B, 
K2H,  EAh,  RA^C.  In  all  there  were  13  positions  In 
eight  aircraft. 

The  F4  and  F14  aircraft  were  selected  as  the 
initial  positions  to  be  described.  Tils  decision 
depended  upon  the  existence  of  the  FI 4  Readiness 
Air  Group  (VF124)  and  Aircrew  Training  Team  whose 
members  had  operational  experience  in  the  F4  and 
were  knowledgeable  concerning  the  systems  in  tue 
F 1 4 .  These  two  Inventories  became  the  basis  for 
tile  Naval  Flight  Off  Leer  Reference  sysftn,  which 
was  a  pool  of  all  NFO  tasks  in  completed  inven- 
t >rles  by  duty  and  role.  For  example,  the  Fa 'FI  4 
tasks  were  the  foundation  for  the  Ah  description, 
while  the  F4/F14/A8  i  t  «.*?n  pool  helped  level  op  the 
P3C.  Local  technical  advisors  reviewed  the  NFo 
Reference  System  to  select  those  task  items  which 
were  identical  and  similar  to  their  aircraft.  An 
interview  was  then  conducted  involving,  an  advisor’s 
comments,  and  additional  items  were  developed  t 
existing  tasks  reworded.  In  tills  wav,  each  inven¬ 
tory  was  standardized  as  to  wording  and  meaning. 
Tills  procedure  enabled  the  performance  at  a  later 
date  of  a  commonality  analysis,  which  Indicated 
similarities  and  differences  between  NFO  positions. 
Revisions,  therefore,  to  the  NFO  tr  lining  program 
could  be  rec .immended  . 

After  the  development  of  a  preliminary  inven¬ 
tory,  selected  members  of  a  replacement  air  group 
(RAG)  squadron  for  the  subject  aircraft  rev i ewe  \ 
the  task  content.  Deletions,  additions  and  reword¬ 
ing  of  task  statements  based  upon  these  comments 
were  incorporated  into  the  final  inventory  which 
was  then  mailed  to  all  the  operational  squad r >ns  in 
the  fleet.  The  average  length  of  these  function  il 
description  was  2H  1  tasks.  Two  seven-point  scales 
were  used  In  the  functional  inventory  to  measure 
either  the  required  proportion  of  time  and  effort 
(Part  of  Position)  or  the  Importance  (Cr it  leal i t vl 
of  each  task/duty 'role  relative  to  the  remaining 
tasks,  dutLes,  roles.  When  the  complete!  p.estion- 
naires  were  returned,  this  Information  was  c>led, 
keypunched  and  analyzed.  A  ’’Part  of  Position"  and 
"Criticality"  mean,  standard  deviation,  percent 
performing,  and  frequency  distribution  was  given 
for  each  role,  dutv,  and  task.  The  average  rate  of 
analyzed  to  mailed  Inventories  by  N’;0  position  was 
HI  percent. 


n  If rgrudnate  J*U  ,» t  Ira  in  in£  Pro  jec  t  O) 

lu  L'J71,  the  dUiet  of  Naval  .»lr  Training 
.'NATRA)  decided  t  »  upgrile,  revise  and  aalc 

pilot  training.  Til-,  program  involved  t Ii r *.*«.■  pipe¬ 
lines  (  pi  wipe*  le  r  ,  K‘  t  •  hel  i  copter)  ,  three  phases 
inrLikity,  !ms  i.: ,  advanced'  .nil  eight  types  of  air¬ 
craft.  T!u‘  author  while  stationed  at  NAM"  I,  in 
"ensacola  was  the  sole  consultant  during  develop- 
‘lent  of  three  task  ,iesc  r  ipt  Lons ,  one  for  eaeh  of 
the  training  pipelines.  Tlie  descriptions  listed 
i!  !  of  the  tasks  an  undergraduate  pilot  performed 
while  he  was  in  training.  The  inventories  when 
completed  were  admin istered  to  all  fleet  replace¬ 
ment  air  groups  (RACs)  lu  order  to  determine  the 
•  '1  lowing  information  on  three  five-point  scales: 

(1)  ihxw  frequently  is  the  task  actually  performed 
at  tin?  RAG  activity?  (Frequency',  (2)  How  Impor¬ 
tant  Is  it  that  students  he  trained  In  the  task  as 
undo rgraduates?  (Criticality),  and  (3)  How  well 
does  th-  training  command  presently  train  students 
In  the  task  relative  to  RAG  entry  level  require¬ 
ments?  (Training  Adequacy). 

In  order  to  accomplish  this  task,  it  was 
necessary  to  have  representatives  from  each  of  the 
pipelines  and  stages  of  undergraduate  pilot  train¬ 
ing  (I’PD.  These  representatives  were  Instructed 
in  the  "how  of  task  writing"  and  were  supervised 
throughout  the  development  of  the  inventories  by 
the  author.  To  ensure  a  complete  Inventory  of 
tasks,  a  matrix  w«s  used  on  each  duty.  Tills  sche¬ 
matic  contained  a  behavioral  dimension  of  action 
verbs  from  the  task  taxonomy  (Y  axis)  and  a  func¬ 
tional  dimension  of  equipment  or  goals  (x  axis). 

The  Interior  of  the  matrix  was  completed  by  the 
representative  instructors  with  a  simple  "yes"  or 
"no"  answer  to  the  question  "Is  this  task  done?". 

The  next  step  In  the  development  of  the  In¬ 
ventories  was  the?  comparison  of  tasks  throughout 
the  various  stages  and  phases  of  training.  Pri¬ 
mary  phase  tasks  wore  compared  with  the  tasks  In 
the  various  stages  of  the  Basic  phase,  which  in 
turn  were  compared  with  tasks  of  the  Advance! 
phase.  At  the  conclusion  of  this  step,  there  wore 
three  groups  of  tasks  (jet,  propeller  and  helicop¬ 
ter  pipelines)  which  were  standardized  in  meaning 
and  wording.  In  addition,  a  commonality  analysis 
was  performed  In  order  to  determine  the  common  tasks 
between  pipelines  and  the  specific  tasks  within 
ptpelnes.  This  effort  would  later  allow  for  gen¬ 
eralizations  to  be  stated  concerning  the  HPT  pro¬ 
gram  as  well  as  cross-compar Isons  within  and  be¬ 
tween  Meet  aviation  communities. 

The  three  inventories  were  then  typed  and 
administered  r>  a  limited  number  of  training 
command  Ins t ructors  in  'he  same  questionnaire 
format  t'  be  used  later  In  the  replacement  air 
groups.  The  purpose  of  this  simulation  was  t«>  gain 
Insight  int  '  response  attitudes  toward  the  Inven¬ 
tories.  In  audit  i  m,  the  training  command  Irmtruc- 
t  >rs  wet*-  asked  to  add  or  consolidate  tasks  when 
ie-  ensure  .  These  cxn.nent  s  were  then  Incorporated 
Int  i  ‘tail  version.  Th.-  final  three  inventories 
4*-  r  ••  then  prepare!  for  replacement  air  group  \  l  s- 
t  r  !  -  at  1  < m  .  Du  average  length  of  the  inventories 
w  i  d  *b  t  a  si  s ,  old  the  average  number  of  mammon 
;  i  V«  s  across  the  tl*ree  pipelines  'was  ”h  or  81  pvr- 
•pnr  of  t  V-  tot  il  .  Rich  of  the  Marine  and  Navy 
re;'i  ir*-»menf  air  gr  > ups  <m  b»t;.  the  Fast  and  West 


Goa  its  w»  re  visited.  The  t . » *.  >  ana'  /si,  q  »-  ,  t  1  i.- 
.lali'i.*')  w**r«-  »  tvnpl  et  ed  b  ,  >1  »  ‘it-  : . *  .  r  :  *  ,r 

pH  >ts  or-h'.ird  for  an  .e/erago  I  «  t  1  ■  ri!,*  .  I 

88  ;>e  r«  en  t  . 

I’ poll  letur.i  frw«  !  he  tie:  l,  .1 1  Ii!i  w.:,-  .1.-1 

fir  computer  anal  vs  Is.  Mur.  .  >f  t 1  f  .i-,-*,  •<- 1  e 

analyze!  by  the  •  |* i a n f  1 1  it  1  o-  -i.it  »  !r  r  .  t  Go, 

and  then  the  t.irik*  wen*  rank-  •:  lered.  \ ■ ;  “  .uier- 
enpV.as ize  l"  task  was  ee-llerei  t>  b*  i  n-  wh  1  o  wu  ■> 
ranked  7 OT  or  higher  no  •ituer  tie  '  !  r»*  ..;en.  /"  r 
"criticality"  scales  .ml  VT  ...» r  '  <w«  :  i  the  "i'e- 

quaev"  scale.  A:i  "over  eriph  a  .  L/e  1”  t  re:  ha!  i  r.  - 
verse  order.  This  filtering  te-  hnlqu  -•  i  1  t  .«* 
analysts  to  Isolate  those  task  •  will  .o*-i«-d  •  .  *  •• 
lit:  pro ved  or  added  to  tr  lining,  nu!  t 1  m-  :  I-.V  ,  r'.^r 
could  hr*  redu  ed  or  omitted  f r oi.  train!  m.  TV- 
average  number  of  "o  v  e  remphas  1  /.e  1 "  an.’,  "mdere*-. 
slzed"  tasks  aero*-,  pipelines  wen-  r  •.  s  pee  t  i  .•  e!  ..  * 
and  .  2"  . 

FIS  Task  Peso  r  Ipt  Ion  In  T«*st  and  v  i \\  i.atioi,'  « ' 

Tlie  jmrpose  of  this  effort  was  to  ♦♦/:;>!  -  >r.-  'a- 
feasibility  oi  the  apj>’  i  ca  t  i  on  «•!  t r-a  I  d  ed 

techniques  to  the  test  and  evalustl  m  ;»’■  ,s»-  >f  t-  »• 

F 18  aircraft  system .  He*  aus**  this  air  rift  is  -.In¬ 
gle  seated,  the  pilot  u»kj!  1  he.’*-  r> i r.-  'Iim 

that  of  <i  two-man  fighter  such  as  the  F*  m  r\*. 
During  the  testing  f  the  F!H,  It  was  ther»-f-»re 
considered  imperative  tiiat  the  human  engineer  I  :ig 
aspects  of  the  svst«rn  be  s<T  ut  i  a  l  zee  with  exrr**-°’- 
care  and  that  rapid  ''iwnmicflt  iivi  def  1  ;  le;.c  l»»s 
to  dec  t  s  1  .>n- inkers  be  implement  el. 

In  response  to  this  need,  fhe  Pi -I ‘1c  N*.  s«ll  »- 
Test  Tenter,  Point  m»h;u  ,  1 1  forni  a  'undel  rhe 

inf'or  in  1^78  to  "develop  an  F.  8  !usk  Taxono**iy 
t;,it  depicts  the  activities  required  of  an  v  1 K  pit  -t 
under  VFR.' JKR  and  dav  night  renditions  and  a.ross 
a’!  mt«slon  profiles."  This  tasking  'was  given  due 
to  the  author  having  "specialized  knowledge  not 
available  eurrently  at  PAGMI 8  TK^TTFS’ .  "  The  task 
inventory  was  to  he  a  part  of  an  ongoing  pr •> ' e r t 
called  Mission  Dperabliitv  Assessment  Technique 
•  M».‘A  P  ,  which  Is  a  toil  t  'r  assessing  man-system 
viimpat  ih  l  i  l  ty  a*-,  related,  to  miss  I  m  success.  The 
goal  was  to  formulate  a  single  interval  s;  a’  e  for 
rating  KIM  ta~Vs  wliich  cnnralned  elements  of  two 
sep  irate  scales  -  avd'- system  effectiveness  and  pi’,  nt 
wo:  k  load.  In  addition,  a  portable  rbv  S 1  o* »  Conput'-r 
wo  b.  1  be  used  to  aid  the  pilots  in  their  ratings 
t-vned  lately  after  f  i  i gh f  *  ^rnp  let! o r. . 

'he  pilot  inventory  was  deve; oped  .Inc  :he 
v3"io.i--*  V'hcnnt’!  !  Vi  ret  if‘*  fcxpinv  pu  1  ‘  it  I  ms  on 
the  FI  8,  and  the  r  mkc  c  'nta1n«'d  ir.  *  he  "t  'r»t  r let* 
of  Alrcrafr"  rpie  'f  tv«-  «.»t  und-- r.;r  adu  i  t  ;  1 1  't 
task  analysis  an!  In  t'.o  >  .sn;p'»>tc  F-i  ha!  ir  I:tt*-rcept 
Of  r  l.  r  ’  *  do  script  l-.m.  Tte  hierarch  Jal  -» t  r.,c  tat  e  f 
the  task  do. si  r  l  pt  I  n  f--l! -  wed  i  r«>lc,  dutv,  task 
out!  i  :ie  is  well  a?,  mission  t  i.r.e-'.  Ines.  Tit  time-!!' 
••lassificut  I«»n  in.  i  tided  t  o  p’ us.js  of  gici.nd  \.»-ra 
f.oJis,  takeorf  ‘  t ,  on  route  ,  tactical,  up  proa.,  a 

lan.ing.  Tht  :  >  >1  o  f  *  nr.  a  t  was  "c-.trji  ler  h  Aircraft 
Vei  ms  ‘liU  iger  in:  h.-pport  "vsteus  Manager,  Thie 
C‘.»mplefod  t  isk  cos.  rlpfi-vi  va*.  checked  ’<v  up,.'  >f  :’,e 
FI  “>  test  pilots  it  rilaxoat  diver,  Marv'anh;  for  .  .’rn- 
|,u,'o,i('S‘!  . t t » * !  a.  c.i  -toy  .  ;iis  c .vn  aen t  s  were  lu  !■•- 
poratc:  into  the  *'  '  it  il  ver.;l  m,  w4;  !  «*h  was  then  glceu 
t  ’  c  ’..i'  vu,.u  .  Vh  \  s  lv.ventorv  consists  I  i! 

;»>  ’  *  ♦,  whl,'5  c-xnanded  t<-  a  :■  pr  ■  \  1 'tvu  t  el  v  ^  ‘  f.mks 

w'  '  o  ‘  ;  i  y  b  •  i.I  s-.-I.iin?  were  c  »n  -  ’’  lered 


!U  VlS  s  1  ;Ml 

Although  three  different  proje*  ts  were  .lh- 
cussed,  tii»*  technique  and  model  wer*-  slnll-it  f»r 
etch  st'iily ,  ami  the  dev«*  1  oped  luveutnr  Ivs  r,*n  lw 
cons  i-.lt*  r  ed  ex  .tuples  of  a  particular  task  analytic 
methodology.  Tins  paper  also  sn.iwed  that  there 
was  a  cvnn:amallty  of  function,  across  jobs,  nis- 
■ilons  and  platforms.  In  general  ,  the  N’Fi>  am! 
pilot  descriptions  !\  v\  much  content  validity  >nd 
nrility.  Both  training  programs  wot a*  Influenced 
bv  the  results  frvim  tie*  Meet.  The  FI#*  desc  r  i  ;>t  i  m 
ot  tilt*  Mil  AT  project,  on  the  tithe?  hand  ,  stil  l  has 
to  show  Its  applicability.  However,  the  pilot*-, 
can  re.ise  the  existing  inventory  wh  [  \  e  It  Is 
being  used  during  the  test  .ml  eval?Mrlon  phase  of 
development.  This  flexibility  should  eventually 
increase  the  inventory's  validity  and  utility. 

Presently,  the  NAMR1.  Detachment  in  New  Orleans 
Is  attempting  ro  develop  a  human  pe  r  f  <  r.iwn  e 
battery  (PF.TKK,  Performance  Evaluation  Tests  for 
Kn  v  l  ro'i’vr.t  aL  Reseirch),  which  will  St-  used  1  r: 
unusual  sad  adverse  environments.  The  ua'.or 
thrust  of  the  program  it  this  moment  Is  to  stndv 
various  cognitive,  perceptual  and  ps>v  homo  tor 
tasks  In  order  to  determine  their  stability  and 
sensitivity  over  repeated  measurements  in  a  labora¬ 
tory  setting,  however,  \  task  analysis  of  various 
T.  b .  Navy  jobs  and  v*?rk  stations  -ms  t  be  conducted 
l*  the  battery  l -?  to  have  applicability  t-'  hu:aan 
performance  under  actual  and  simulated  r  mni  1 1- «ns  . 
This  technique  has  the  capability  to  not  ont  v 
d  .*  sc  r  1  He  a  pa  rticul  a  r  job,  but  t  *  isolate  the 
critlcil  components  of  that  Jo*.  rhea*-  elements 
in  turn  vr>nld  provide  the  basis  for  a  performance 
-x.1  a su remen t  system,  which  can  he  ut  1 !  1  red  1  n  both 
the  laboratory  and  the  actual  environment .  Tu 
conclusion,  the  a*ithor  believes  that  the  methodo¬ 
logy  and  model  discussed  In  this  paper  v* 1 !  aid  in 
the  development  of  function  a'  Inventories  and  in 
toe  assessment  of  performance  in  the  oceanic 
environment,  md  therefore  will  influence*  th^ 

,*r  vt!1.  of  the  NAMRLD  battery. 
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A  COMPARISON  OK  TACTICAL  NAVAl.  wiiKK  STATIONS  WI  i  *i  I  N  THE  A  f  K  AND  SKA  ENVIRONMENTS 
Richard  H,  S!ut:mi)a  h  Robert  i^rrer 
NAVAL  BIODVNAMICS  LABORATORY,  NEW  ORLEANS,  I.A.  701HV 

I  NTKODUC  HON 

1  he  Naval  Hlodynamlvrf  Laboratory  is  dt*vel  op—  env  1  routniMit  .  The  ClCO  in.iMitorv  out 

iug  .1  human  p«*  r  fu  nuance  bacterv  which  will  be  performed  by  two  individuals  in 

used  to  study  behavior  under  unusual  and  adverse  environment, 
venditions.  To  facilitate  the  aceompl ishwent  of 

this  goal  ,  a  task  analysis  of  various  Navy  jobs  COMMUNAL!  FY  ANALYSIS 

and  work  stations  Is  being  conducted.  Prior  The  two  work  station  descrip 


L"  .  1  t  dsK  S 

a i r borne 


efforts  under  this  project  which  utilized  this 
..nalvtlet!  tool  can  be  found  in  Shannon 
( l sSOci  ,h  ,c  ,d)  .  The  present  study  extends  this 
woik  hv  comparing  two  work  stations  which  have 
similar  tactical  missions  and  whose  tasks  are 
performed  in  two  different  environments.  The 
hypothesis  used  in  this  comparison  is  that  there 
i  s  a  nigh  commonality  of  human  work  functions 
•  cross  jobs  having  similar  mission  orientations 
►wen  when  there  are  differences  in  equipment, 
pi  1 1 1  ■>  Pn  and  environment.  The  two  work  stations 
inily^ed  ire  the  tactical  tasks  of  the  Combat 
Intornafl  >n  Center  (CIC)  of  Navy  ships  and  the 
Cinbtt  Inforiwt  ion  Control  Officer  (ClCO)  aboard 
the  Hi  aircraft.  in  addition,  the  statistical 
inilyses  of  a  preliminary  battery  to  assess  C1C 
performance  will  be  discussed. 

TASK  INVENTORY  DEVELOPMENT 

Task  inventory  development  Is  performed  in 
;n dually  refined  stages  with  the  analysis  pro¬ 
ceeding  t'r  un  large  units  of  Information  blocks  to 
successively  more  detailed  lower  levels.  The 
ju  il  it  »t  i/e  model  the  two  efforts  described  in 
t’n!  *  paper  followed  a  job,  role,  duty,  task,  and 
element  hierirchl.il  breakdown.  In  this  model,  a 
job  was  defined  by  its  roles,  a  role  by  its 
inti  os,  i  iuty  by  Its  tasks,  and  a  task  by  Its 
;•  ■•'v.Us.  \  task  can  also  bo  defined  as  a  unit 

of  work  which  is  directed  toward  the  aceompl Ish- 
t  of  a  goal  . 

A  r!,nl  inventory  of  240  t  isks  pertaining  to 
th»*  C. *■>.:,.*  •  Info  rsr.it  L  'i  Control  Officer  (ClCO) 
within  the  I'.l  aircraft  wa^>  written.  Content 
vi*.  idify  was  *st.ibllshed  using  subject-matter 
vA.>e t  s  and  existing  task  descriptions  during  in- 
,'*‘ut)ry  development.  Two  seven-point  scale:-*  were 
.  ••!  In  trie  functional  Inventory  to  measure 
■  *  1 1  h  e  r  rh  rejai.  red  proportion  of  time  and  effort 
•'.Port  of  Position)  or  the  Importance  (Criticality) 
of  ouch  task,  luty .  and  role.  A  sample  of  IS 
people  ciM:i,,leted  the  task  analytic  questionnaires. 
Ydditional  information  concerning  K2  ta  ->k  i.ivt  n- 
t  tv  development  *nd  analysis  can  he  f-mn  1  in 
'h.muon 

A  pt  eL  iiii ilia rv  t.is'  inventory  uou  ernlng  the 
’.jit  1  afo  r  na  t  ion  Center  aboard  Naw  >*hIp->  was 


COMMUNAL!  H*  ANALYSIS 

The  two  work  station  descriptions  were 
studied  using  the  Position  Analysis  Ones l ionia i re 
(PAQ)  (McCormick,  Jeanneret,  and  Mecham,  1472,/  in 
order  to  translate  the  specific  tasks  related  t* 
different  envi  r  oilmen  Is,  woik  stations,  and  equl  >- 
men t  into  common  task  elements.  This  quest  i.n- 
naire  Ls  couipo  >«d  of  194  elements  w;  ich  are 
separated  into  six  divisions:  Information  input, 
mental  processes,  work  output,  relationships  wifi 
others,  job  nontext,  and  other  job  charac  ter  !  st  ics  . 
The  PAQ  element  scores  were  converted  to  4S  •'oh 
factor  sci* res  by  using  factor  loadings  developed 
for  22*10  jobs  by  McCormick  et  al  .  ‘Hie  -*  S  factors 
(dimensions)  include  H  for  the  six  divisions  out 
lined  above  and  12  for  the  overal 1  job. 

Separate  PAQ  analyses  were  conducted  by 
two  different  researchers,  one  for  CtC  and  the 
other  for  ClCO.  Mecham,  McCormick  and  leanneret 
<1977)  suggest  that  agreement  between  PAQ  analysts 
be  indie, ited  bv  a  product-moment  correlation  of 
their  194  job  element  ratings.  The  cor rel  a t ion 
between  both  sets  of  ratings  (CIC  6  CIC'Vi  was 
£  =  .83.  '*even  ..  f  tiie  194  elements  were  the  major 
sources  of  J isagri  emeu t  between  analysts,  and 
without  those  elements  the  correlation  was 
£  “  .91.  These  elements  reflected  di  tfe.ee  nee  s  in 
manning  levels  (e.g.,  C1C  has  more  people,  so 
there  is  more  supervision')  and  environment  , 

CIO>  includes  airborne  vibration,  noise,  and 
close  quarters  that  are  not  characteristic  of 
CIO.  The  two  analysts*  ratings  wire  converted 
to  f  ictor  so  ires  on  toe  s Y  dimens!  m*-  of  the  PA- 
and  the  resulting  correlation  between 
factor  scores  was  r  -  .1  S.  If  the  six  M'tors 

(job  dimensions')  related  to  maim  levels  and 

vor1’  environment  were  not  considered,  ike  corre¬ 
lation  was  £  •-  .8'.  These  ;  so  1  t  indie  st  e 

that  (a'»  the  analysts  ire  reliable,  an  f  (M  the 

C I  C  a  nil  C  I O  i  -  a  r >_  ex  l  retnc  1  y  i :  1  *  a  r  i  o  s  p  ;  r «. 

difference-.  >f  »•  {.;  1  pmea  i ,  phitfor,!,  •m.:  encir  .  .«  it 
Therefore,  tnese  c.  >r  re!  at  ions  lend  <u  rt  ti 


W.l  •; 


and  performing  cl  e  r  !  cal  h el  at  .*  1  act  1  v  i  t  it"-..  ‘hr 
4  ink.*  ns  it' us  that  are  common  to  ixith  'hr  :  IL  and 
CU'O  work  st.it  1<>u  lypltv  -olis  i.iv1-'!  vin.;  -n i  ■  It  try 
tactical  control.  The  rad  Incuts  >•(  such  *•■!»-,  «re 
c.xnraand,  control  .  c»mvmmi  cat  l on  ,  and  c  n»r  1  i  *:  i  f  t ‘>n  . 
It  is  hv  pothes  i /e.l  that  \oh--.  i  .*  f  W-v  *■  in  \  t  Ur  -a* 
ch.i r  u* f  er is t  lex  will  have  similar  hd*  dimon? 

In  addition  to  the  PAD  dimension^,  Jn  ■  .nnnun,  i.i1.* 
an.!  Flt'.D  each  have  unique  a-iiu’r  is.  illO )  was 
characterized  hv  heinyt  in  hazardous  job  situations, 
purl  arming  unstructured  work,  and  wor  king  in  an 
unp  1  e  tsan  t 'huza rdous/domand l tig  envi  roument  .  The 
hiv’  dimensions  unique  to  f  *  I  <  *  were  perfop-jtt.1. 
supervi  so  rv  ,'caor  dlnat  Ion  'rel  at  ed  act  ivities,  ex- 
i an.>  i  in;  job-related  i  nf  opna  r  ton  ,  and  so  per  / 1  s- 
1 p ,»  d  i  r e c 1 1  n g ' es *  i’lut  in . 

sK.l  K-:n«>N  s  FVAU'ATlON 

Th i ■  assumption  that  various  ( ohs  can  he  c im¬ 
posed  .O'  th»'  same  human  work  function*  *  ,  a  basis 
for  the  concept  of  job  cm;vitu»r.  t  validity 
i  Me  dorm  i  ck  ,  \  D  7  *) )  .  1  he  praoe  lurr'  for  *-stahlish— 

in-;  v-ilidfty  Includes:  (O  ident'fi-  at  Ion  of  the 
work  functions  and  their  relative  imp*' f"  a  ice ,  «u* 
dete rmlnat ion  of  human  attributes  associated  with 
successful  performance  of  the  work  iniud  i.ins,  and 
<c)  combination  of  the  attribute  requirements 
associated  with  each  funct  ion  into  an  .-timate  of 
the  requ  i  reuent  s  for  the  entire  job.  Il  the  job 
component  validation  Is  siu:ces->t u  !  ,  r'ien  the 
human  attributes  and,  work  fun 't  -  as  acquire 
construct  validity.  Of  course,  job  c.-.-ouent 
validity  effort  presumes  that  a  taxonomy  of  work 
functions  and  a  method  for  me.isurim;  a!!  rei  event 
human  attributes  are  available.  both  o’  these 
needs  can  he  me  t  through  the  use  of  r’A‘0  and 

the  proper  selection  of  psychological  tests  to 
measure  human  attributes  (Carter,  Kennedy,  and 
Hittner,  IDS  O'* . 

What,  then,  are  the  human  attributes  required 
by  these  two  jobs  and  how  can  they  be  measured? 
It  was  decided  that  those  P.\0  elements,  which  are 
rated  as  very  Important  and  »re  Identified  .ts  a 
part  of  important  job  dimensions,  represent  the 
essential  attributes  of  f'.lC  and  UIG*'».  The  SH  PVJ 
elements  which  qualified  were  compared  with  tests 
from  the  Kit  of  Cognitive  Factors  by  Kk  strom, 
French,  Harman,  and  Demen  (lD7n).  -'ne  test  was 
selected  to  represent  each  factor  In  the  Klf,  and 
then  the  tests  were  evaluated  for  their  relation¬ 
ship  to  each  of  the  SB  essential  work  elements. 
Seven  tests  were  selected  which  had  the  highest 
number  of  PAf)  elements.  The  emphasis  of  these 
tests  was  upon  perceptual,  reasoning,  and  numeri¬ 
cal  abilities. 

Those  tests  were  admin  i  store’!  as  a  pilot 
study  to  eight  Navy  enlisted  volunteers  once  a 
day  for  10  consecutive  weekdays  (Saturday  and 
Sunday  excluded).  The  order  of  the  tests  for  ill 
subjects  was  randomized  between  days  but  remained 
the  same  within  days.  Dally  means,  variances,  ind 
the  interday  (lntertrlal)  correlations  of  each 
test  were  calculated.  Two  of  the  tests  showed 
substint  til  linear  increases  of  the  1 r  neon  scores 
across  the  \ D-day  experiment.  Ninety-five  percent 
of  the  variance  of  Midden  Figures  dally  means  was 
linear,  and  (>b  percent  of  the  variance  of  the 


Maze  Tracing  mr.ins  was  !ln**ur.  T*;.-  ,1  )•»«•',  w>  r«- 

.  ; and  1  .  *>  un  1 1  s  ;>-*r  lay,  r  -  -  ’  !,’*.*!>.  *h  1 

other  test-,  had  less  than  '  !  ;u  r.-.-iO  »!  t*.«- 

variance  of  their  mean*,  i  r  t  r 1  '■  it  a1  !  *  t<>  i  iln.-i: 
trend;  the  s.’ores  wr*-  no!  ippre-  iiMv  if  ♦ « •  r .  i 
V,v  practice.  Similarly,  the  wi  t ’■  ia-.i  iv  virl  t"  < 
of  at  1  seven  tests  Were  little  after  ted  Sy  pr  icltc 
In  addition,  Intertrial  rorrd  it  l.»:i>,  w«  re  stuii»*d 
in  order  to  determine  t  lie  reliability  or  me  is  de¬ 
merit  among  the  suhlects  from  d  iv  to  aav.  Alter 
all,  a  test  Is  of  little  value  iv  it  measures  i 
transient  character  l  st  i<- .  !w  of  the  ?ex*-i, 
Building  Memory,  and  Dec  i  plier  1  ng  i.an.-u  ig-.- ,  did 
not  measure  a  consistent  factor  across  !n  s.  A  -m 
factor  solution  for  each,  test  showe  1  t-.at  <n.  •' 
JD  percent  and  A 1  percent,  rtmp’i- 1  i  vel  y .  >f  the 
variance  was  being  explained.  Another  test,  Mu/r 
Tracing,  appeared  to  measure  the  same  fa  t . « r 
(spatial  scanning)  every  time  it  was  adminlsterei 
with  B1  percent  of  the  variance  being  explained 
across  the  10  days.  The  remaining  tests  f Mid  den 
Figures,  Form  Hoard,  Addition,  and  Mathematics 
Aptitude)  were  of  intermediate  general izah i i : tv 
across  days.  They  had  7A,  71,  b>,  and  Y)  percent, 
respectively,  of  their  variance  across  days 
explained  using  i  single  factor  solution.  In 
summary,  several  of  the  tests  appeared  to  measure 
persistent  attributes  of  the  subjects  and  to  be 
related  to  the  CIC  and  CLOO  jobs.  The  more  prom¬ 
ising  tests  will  be  examined  with  larger  gr  >aps 
of  subjects.  Kennedy,  Carter,  and  Bittner  (19S0J 
have  used  a  similar  method  to  identify  other 
tests  that  measure  general izahle  human  attributes 
which  may  be  useful  for  job  component  validation. 


IMPLICATIONS 

identifying  tests  that  are  related  to  jobs 
is  only  the  second  phase  of  an  effort  to  estab¬ 
lish  validity.  The  importance,  or  weight  in  the 
performance  prediction  equation,  of  each  test  is 
yet  to  he  established.  These  weights  could  be 
obtained  from  the  ratings  of  the  importance  of 
FAQ  elements  to  each  job,  and  from  ratings  of  the 
extent  to  which  each  performance  test  represents 
the  elements.  The  resulting  weighted  test  battery 
could  be  used  to  predict  performance  on  the  ^ob, 
or  to  study  the  effect  of  envi ronmcntal  stress  on 
job  performance.  Furthermore,  this  Information 
would  provide  a  basis  for  synthesizing  an  anal og 
to  the  job  from  the  tests.  By  taking  into  account 
other  important  job  attributes  (like  task  sequenc¬ 
ing,  consequences  of  errors,  rates  of  performance, 
and  crltlcalitv  of  tasks),  a  simulated  iob  could 
be  constructed  from  the  tests,  just  as  complex 
molecules  are  constructed  from  a  few  simple 
elements  In  another  domain  of  science.  .Job  com¬ 
ponent  validity  is  the  first  step  in  the  evolu¬ 
tion  of  a  science  of  work  behavior,  and  job 
analysis  is  the  first  step  in  job  component 
val Ida  t ion . 


(RF.KKRKNCHS  supplied  by  the  authors  upon 
reques t  . ) 
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